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abstract 

Blum's  aa  chine- independent  treatE*.n»- 
recursive  function,  i.  extended  to  r^UvfaWi^  *  °f  Partial 
by  Turing  machine.  with  oracle.)  w*  nrn!»  S*?"*  *«*  repre.ented 
results  of  Blum  complex!  ^ of  ~v*al 

recursive  relatedne*.  theorem  i.  Proved  Vth?  coaPref8ion  theorem.  A 
complexity  iseuures  ere  ““SJ*  £T?>  ' 'J0'1"’  °>*‘  “V  '•»  rel.tiv. 
tNcorac  .Uo»,  „  to  Z<Sr£L£'J‘t  «=“•»»•  function.  Thi. 

for  •  particular  Mature.  reeulte  for  all  meaeurea  from  proof. 

to  complexity  2u  te^^'JC“lt‘*‘  ■  “>•  WW  notion 
recuraivs  nduclMlltiu  are  rediciiilitlei”of '0.^^'''^  "a  PrlMtlv* 
commonly. tudied  reducibilitle.  are  not  type'  whI1*  °ther 

tion  of  fnne. 

computation  of  the  function)  h  ^  d  8  "*  or4cle  in  the 

are  proved,  including  non-trwsitivitr^d’b^d0*  ***„' "helpin9"  relation 
certain  sets  can  provide.  V  d  bounds  on  the  amount  of  help 

other '«  computation^are* proved^*they*are8  S°Ut  “f*  “***  don’t  ^P  each 
of-unsolvability  theorem.?  with  simil*^  8u^r«cur«ive  analog,  to  Uegrees- 
priority  arguments.  In  partWa^^d?  *  dia9°na libation  and 

"universally-helped  set  «  d*8cu*c  tbe  existence  of  a 

The  deepest  result  is  a  finite-inlur?**^*1*  r*8Ulta  in  1x3 ^  directions, 
apparent  recursive  bound  on  the  n^r^SiLSJTIhi  *" 

preserving  an  arbitrary  lower  bound  on  the  ^xity  of  .^el^8 

Our  methods  of  proof  include  nmnf  •  . 

and  appeal  to  recursive  rel^ted^ess^iaaoL^  me“ure  *pace) 

and  heavy  use  of  arguments  about  the  domlin  v*  0^°"  "d  Pri°rity  techniques, 
recursive  functions  in  order  to  defined  ^TiTtZllo^ 
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1.  Introduction 

Blun  fBl]  Introduces  an  axiomatic  framework  for  discussing  the 
complexity  of  partial  recursive  functions  of  Integer  variables.  In 
this  thesis,  we  use  a  parallel  approach  for  the  case  of  relative 
algorithms  (l.e.  partial  recursive  functions  of  one  integer  and  one  set 
variable,  as  represented  by  Turing  machines  with  oracles  fD]  fRol)'. 

Our  extension  of  Bliss's  ideas  allows  us  to  discuss  axiomatically 
several  problems  impossible  to  formulate  from  the  original  set  of 
axioms. 

For  example,  we  can  formalize  the  Idea  that  one  function  helps 
the  computation  of  a  second  function;  we  can  also  give  some  meaning  to 
"the  complexity  of  a  nonrecurslve  function." 

Th®  axioms  we  give  include  as  special  cases  the  "natural"  measures 
y,n  r«l*tlve  computations,  namely  the  time  and  space  measures  on  oracle 
Turing  machines.  Thus,  the  axiomatic  statements  of  our  various 
theorems  are  also  true  when  Interpreted  for  the  specific  measures.  If 
we  were  to  state  and  prove  our  theorems  directly  for  the  time  and 
space  measure,  the  results  would  be  more  precise  and  the  proofs  more 
Intuitive.  However,  the  axiomatic  proofs  are  much  shorter  and  cleaner; 
therefore,  our  general  policy  in  this  thesis  is  to  state  and  prove 
results  axiomatically,  giving  intuitive  remarks  about  time  and  space 
wherever  possible. 

In  Chapter  2,  we  present  our  axioms  for  relative  complexity  and 
prove  some  basic  results  suggested  by  theorems  of  non-relatlvlzed 
complexity  theory. 


The  first  important  result  is  that  any  two  tneasures  satisfying 
the  axioms  are  recursively  related;  the  proof  is  by  Konig’s  lemma. 

This  theorem  is  important  primarily  because  it  provides  an  alternative 
method  of  proof  of  general-measure  theorems.  Certain  types  of  theorems 
may  be  proved  easily  for  a  particular  measure  (usually  space;  end  then 
the  recursive  relatedness  between  space  and  other  measures  can  give 
the  general  result.  We  employ  this  method  occasionally. 

We  note  that  the  standard  results  of  complexity  theory,  such  as 
speed-up,  compression  and  gap  theorems  THH]  all  have  full  relativi.a- 
tions  with  proofs  exactly  like  the  usual  proofs.  Several  partial 
relativiaations  are  also  true;  we  prove  some  which  are  of  interest  or 
will  be  of  later  use.  In  particular,  we  prove  a  relativisation  of 
the  combining  lemma  fHH],  which  states  that  the  complexity  of  a  compu¬ 
tation  is  closely  related  to  the  complexity  of  its  subcomputations. 

This  will  imply  some  later  results;  it  is  the  first  example  of  our  use 
of  a  method  of  proof  which  we  call  the  "domain-of-convergence"  method, 
and  which  is  used  in  axiomatic  proofs  throughout  the  thesis. 

In  Chapters  3-6,  we  study  questions  natural  to  treatment  within 
relative  complexity  theory. 

A  notion  nhich  parallels  that  of  a  complexity  claa.  IMcCl  IMcCMel 
in  the  relativised  theory  it  that  of  a  "complexity-determined  reducl- 
bility,"  which  we  study  in  Chapter  3. 

To  any  class  C  of  functions  corresponds: 

((A,B)|A  is  computable  from  B  within  measure  equal  to  some  function  in v 
For  certain  classes  C,  this  provides  a  reasonable  reducibility. 


/ 


* 


.  ' 
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Truth-table  reducibility  fRol)  and  the  relation  "primitive  recursive 
in"  fKj  are  examples  of  reducibilities  of  this  type,  while  other 

« 

conmonly-studied  reducibilities  such  as  many-one  and  one-one  reduci¬ 
bilities  fRol]  are  not.  * 

We  show  that  neither  truth- table  reducibility  nor  primitive 

i  1 

recursive  reducibility  can  be  completely  specified  by  a  single  bound 
function  (i.e.  a  singleton  class  C  ) .  However,  each  may  be  so  specified 
on  any  countable  class  of  oracle  sets,  as  we  show  by  a  relativization 
of  the  Meyer -McCr eight  union  theorem  [McC]  fMcCMe].  For  example, 
there  is  a  function  t  such  that: 

i 

(A  B  **  A  is  computable  from  B  within  measure  t) 
for  all  arithmetical  sets  A  and  B. 

1  i 

By  selecting  special  classes  of  functions  C  ,  we  may  define 
new  complexity-determined  reducibilities;  for  example,  by  letting:  , 

C  m  {A-recursive  functions] 

for  some  set  A,  we  define  a  reducibility  somewhere  between  truth-table 
and  Turing  reducibility,  which  we  call  "A-reducibility."  By 
considering  all  sets  A,  we  arrive  at  a  hierarchy  of  reducibilities. 

A  relativization  of  the  compression  theorem  shows  that: 

(VA,B) f (A-reducibility  *  B-reducibility)  «  (A-recursive  functions 
and  B-recu?:sive  functions  are  the  "same  size")]. 

I  ’  8 

This  fact  reduces  questions  about  the  reducibility  hierarchy  to 
purely  recursion-theoretic  questions;  we  prove  several  results  about 
this  hierarchy,  for  example,  that  there  exist  Turing-incomparable 
sets  determining  the  same  reducibl  e  ty. 


1 
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Independence  results  (theorems  that  state  chat  certain  acts  dc 
not  help  the  computation  of  certain  recursive  functions)  are  analogous 
to  theorems  about  functions  having  a  certain  lower  bound  on  their 
complexity;  diagonaliration  is  the  only  tool  we  have  for  proving  them. 
We  prove  a  version  of  the  following  statement: 

l ,  « 

"There  exist  pairs  of  complex  recursive  sets  that  don't 
help  each  other's  computation." 

i  1 

We  use  a  diagonaliaation  method  in  the  proof,  based  on  work  b  Meyer, 
M.J.  Fischer  and  Trachtenbrot;  priorities  are  used.  We  first  construct 
a  set.  with  no  interdependence  between  the  values  of  its  characteristic 
function  at  different  arguments.  We  then  split  this  set  into  two 
pieces  and  argue  that  neither  piece  can  help  the  other's  computation. 

This  result  illustrates  proof  techniques  which  will  be  used  in  a 
more  complicated  fashion  in  Chapter  6.  It  has  several  interesting 
corollaries,  includir^  the  fact  that  "helping"  is  not  a  transitive 

'  '  I  | 

relation.  , 

I  I  '  .  ! 

Since  the  independent  sets  are ,  constructed  by  a  diagonaliaation, 

iC  is  difficult  to  understand  much  about  them.  A  more  interesting 
result  would  arise  if  we  could  arbitrarily  fix  one  of  the  sets. 

Thus,  in  Chapters  5  and  6,  we  ask  the  following  question: 

1 

Which  is  true? 

.  ‘  !  1 

(1)  There  is  a  recursive  set  A  whose  computation  is  helped 

by  all  sufficiently  complex  re  ursive  sets  3  (a  "universally- 
helped  set"),  or 

•  i 

! 


i 
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(2)  For  *11  recursive  sets  A,  there  exist  arbitrarily 

complex  recursive  sets  B  that  don't  help  the  compute '-.ion  of  A. 

We  obtain  some  partial  results  in  both  directions,  using  different 
interpretations  of  "helping." 

In  Chapter  5,  we  produce  the  strongest  results  we  can  to  obtain 
the  first  answer.  We  note  that  the  complexity  axioms  are  sufficiently 
general  to  be  satisfied  by  various  "pathological"  measures;  specifically, 
that  any  recursive  set  will  be  a  "universally-helped  set"  in  some 
relative  complexity  measure.  From  here  on,  we  use  a  mechanism  for 
eliminating  such  trivial  cases. 

We  go  on,  in  theorem  5.2,  to  construct  sets  which  are  not 
"universally-helped,"  but  which  are  "almost  universally-helped,"  in 
the  sense  that  they  are  helped  by  all  recursive  sets  whose  complexity 
is  "nicely  determined."  More  specifically,  for  any  recursive  function 
h,  we  obtain  a  recursive  set  A^  such  that  the  computation  of  A^’s 
characteristic  function  is  helped  on  infinitely  many  arguments  by  any 
recursive  set  whose  complexity  is  (to  within  accuracy  h)  equal  to  a 
running  time.  This  is  the  strongest  result  we  have  obtained  in  the 
direction  of  answer  (1). 

In  Chapter  6,  ve  work  in  the  opposite  direction,  beginning  with 
s  recursive  set  A  and  constructing  sets  B  not  helping  A's  computation. 

As  before,  we  use  diagonal lcation  and  priority  techniques  in  obtaining 
our  results.  There  are  two  -najor  results  in  the  chapter. 


The  first  theorem,  theorem  6.2,  states  the  following: 


11 

If  VC  have  a  recursive  set  A  and  a  recursive  function  t^, 
with  the  property  every  Turing  machine  computing  A's  characteristic 

function  requires  more  than  t  space  on  an  infinite  set  of  arguments, 
then  there  are  arbitrarily  complex  recursive  sets  B  such  that  every 
B-oracle  TuriT«  machine  computing  A's  characteristic  function  still 
requires  more  than  tA  space  on  an  infinite  set  of  arguments. 

The  proof  idea  is  due  to  Machtey  (Mai)  and  involves  a  diagonali- 
satlon  with  simple  priorities. 

The  second  theorem,  theorem  6.3,  states  that,  provided  ve 
restrict  our  attention  to  functions  t^  which  are  running  times,  ve 
have  a  similar  result  to  theorem  6.2  for  a  different  type  of  lover 
bound  t  .  Namely,  if  ve  have  a  recursive  set  A  and  a  total  running 

A 

time  t.  with  the  property  that  every  Turing  machine  computing  A's 

A 

characteristic  function  requires  acre  than  tA  space  on  almost  all 
arguments,  r.hen  there  are  arbitrarily  complex  recursive  sets  B  such 
lhat  every  B-oracle  Turing  machine  computing  A's  characteristic 
function  still  requires  more  than  tA  space  on  almost  all  arguments. 

This  theorem  is  the  deepest  result  in  the  thesis.  The 
diagonalisation  required  is  considerably  more  complicated  than  that 
required  for  theorem  6.2,  and  involves  a  finite-injury  priority 
argument  in  which  there  is  no  apparent  recursive  bound  on  the  number 
of  times  a  requirement  may  be  injured. 

The  independence  results  serve  to  demonstrate  that  there  exist 
arbitrarily  complex  pairs  of  recursive  sets  which  are  recursive  or 


"different  reasons." 
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There  Is,  of  course,  no  conflict  between  the  results  of  Chapters 
5  and  6,  ae  we  show. 

Open  problems  are  Interspersed  throughout  the  thesis  as  they 
arise,  and  are  collected  In  Chapter  7.  Also,  In  Chapter  7,  ve  present 
additional  open  problems  and  directions  for  further  research.  One 
particular  direction  atentloned  Is  that  studied  by  Symes  In  fSy), 
where  he  considers  helping  not  only  by  oracle  sets,  but  also  by 
partial  functions.  In  general,  ve  would  like  to  formalise  other 
lotions  of  "helping,"  specifically  those  which  represent  the  way  In 
which  a  subroutine  "helps"  the  computation  of  a  function  computed 
by  a  computer  program. 
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2.  flotation,  Axioms  and  Baalc  Results 

Wa  assume  familiarity  with  th«  notation  used  by  Rogers  rRol). 

We  uae  '(  *  "  and  "a.e.  (x)"  to  mean  "for  all  but  a  finite 
apbcr  of  x."  When  no  confuaion  la  likely,  we  alaply  write  "a  e." 
("almost  everywhere"). 

Similarly,  "(*x)"  or  "t.o.  (x)"  mean a  "for  Infinitely  many  x," 
and  we  write  "l.o."  to  mean  "infinitely  often." 

We  write  "a  -  b"  to  mean  ja  -  b  if  a  a  b 

(0  if  a  <b. 

The  composition  "g  o  t"  where  t  is  a  function  of  one  variable 
and  g  la  a  function  of  two  varlablea,  will  indicate  Xxfg(x, t(x)) J. 

"Rn"  repreaenta  the  act  of  total  recuralve  functiona  of  n  integer 
varlablea. 

ttB  (A),, 

Rn  repreaenta  the  act  of  total  A-recurslve  functiona  of  n 
integer  varlablea. 


"Pn"  r*Pr«**nta  the  set  of  partial  recuralve  functiona  of  n 
integer  varlablea. 

"  r*Pre®*T,t®  the  aet  of  partial  A-recuraive  functiona  of  n 
Integer  varlablea. 

We  write  "t"  for  divergence  and  "1"  for  convergence  of  compu¬ 


tations. 
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"IXJ"  represent*  the  Integer  pert  of  It. 

For  eny  1-  A,  If  qc^^x)!,  ve  uee  the  convention  that 
04<A^(x)  •  *•  ®y  convention,  •  <  «»,  and  n  <  •  for  any  n  e  N. 

The  notions  of  "relative  algorithm"  and  of  an  enumeration  of 
relative  algorithms  (9^  are  amply  described  In  fRol,  9.2], 
Specifically,  we  uae  the  following: 

Definition  2.1:  A  sequence  (<Pt(  ^  of  relative  algorithms  Is  called 
"acceptable"  If: 

(1)  (9^  Includes  all  relative  algorithms 

(2)  Universal  Property: 

<3*  c  {.p^  )})(Vl,x,A)  rt(A)(<i,x»  -91(A)(x)i 

(3)  s-m-n  Property: 

(Y*  €  C<P1(  )))(2«  €  RjXVl.x.A)  FPs(l)(A)(x)  -  t(A)(<l,x»]. 
We  discover  by  methods  analogous  to  those  used  In  fRo2]  that: 


2,2:  Let  (<Pt(  and  be  any  two  acceptable 


orderlies  of  relative  algorithms.  Then  there  exists  a  recursive 
Isomorphism  r  such  that: 


Lemma  2.2  will  make  our  theory  Independent  of  the  particular 
formalism  chosen.  We  will  generally  refer  to  the  development  In 
fRol]  or  to  the  notion  of  an  oracle  Turing  machine  when  precision 
Is  required. 


We  now  define  a  "relative  complexity  measure." 


Definition  2.3  A  relative  complexity  neasure  *  '  H  *  collection  of 

partial  functions  from  N  to  N,  l*t  ,  one  for  each  (i.A),  aatisfylng 

the  following  two  conditions: 

(1)  (Vi, A)  fdooaln  -  domain  A)  1 

(2)  There  exists  t(  \  a  relative  algorithm,  such  that: 

11  if*1(A)(x)-y 

<«•■•»•*>  ♦<*><<i-’,’y>)  ■  {„  othervl<, 
w.  rtbt«u«.  «  V  t,(W  *■  v  ">•  f"I'tlon*  *1 

are  often  referred  to  informally  as  "running  times."  There  Is  no 

(0) 

confusion  h.re  with  the  usuel  Coael  nusiberln?  notetlon.  u  lVl  ) 

1.  en  eccepteble  cSd.l  nunberlng  for  the  pertlel  recursive  functions 

|Ro2). 


A  note  on  our  choice  of  axioms:  axiom  (1)  Is  surely  rea.on.bla, 
but  It  may  be  thought  that  axiom  (2)  Is  stronger  than  we  ought  to 
assume.  However,  both  axiom,  are  satisfied  by  all  natural  measure, 
on  relative  computations  (l.e.  time  and  space  on  oracle  Turing  machine.) 
Also,  axiom  (2)  Is  plausible  in  that  it  merely  requires  the 
existence  of  a  single  "unified  description"  of  any  measure. 


Thus,  for  the  time  measure,  axiom  (1)  s.y«  that  a  computation 
take,  a  finite  amount  of  time  If  and  only  If  It  converges,  and  axiom 
(2)  says  that  w.  can  effectively  tell  If  a  computation  halt.  In  a 


given  number  of  steps. 


For  the  space  measure,  axiom  (1)  says  that 


e  computation  use.  a  finite  number  of  tape  square,  if  and  only  If 
It  converges,  while  axiom  (2)  says  that  we  can  effectively  tell  If  a 
computation  halts  without  exceeding  a  given  amount  of  workspace. 
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Later  In  the  chapter,  we  verify  that  theae  axioms  hold  for  time  and 
apace  reeasurea. 

Theae  axioms  are  extremely  simple,  and  similar  to  Blum's  axioms 
for  partial  recursive  functions  [ Bll .  We  will  see  In  the  following 
chapters  thrt  they  are  quite  powerful. 

We  refer  to  (Sy,  Chapter  3)  for  some  Interesting  results  using 
theae  axioms.  In  particular,  we  shall  use  the  fact  that  •  ^(x)  Is 
a  partial  recursive  function  of  x,  uniformly  1*»  A  and  1.  That  Is: 

(3a)(VA,l,x)  (<p#(A)(<l,x>)  -  ^(x)]. 

In  spite  of  the  theory's  Independence  of  the  particular 
formalisation  of  relative  algorithm,  enumeration  and  measure.  It  la 
desirable  to  keep  In  mind  the  natural  measures  (time  and  space  on 
orac'r  Turing  machines).  The  particular  oracle  Turing  machine  model 
we  will  use  la  as  follows: 

Each  Turing  machine  has  four  seml-lnfinlte  tapes:  an  Input  tape, 
an  output  tape,  an  oracle  tape  and  a  worktape.  The  first  three  are 
marked  In  binary,  with  the  exception  that  the  Input  tape  has  a  marker 
to  Indicate  the  end  of  the  Input.  The  worktape  has  k  possible  symbols, 
for  some  number  k  which  depends  on  the  machine.  We  assume  for 
definiteness  that  the  Input  and  output  heads  cannot  move  left.  Also, 
the  machine  cannot  write  on  Its  Input  tape  or  read  from  Its  output 
tape.  There  are  otherwise  no  restrictions  on  the  operation  of  the 
machine,  other  than  the  usual  Turing  machine  constraints  [Roll. 


This  Turing  machine  Is  designed  to  be  used  In  conjunction  with  an 
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'oracle'  for  any  net.  (An  X-orcele  la  an  unspecified  agent  having 
Information  about  set  X.)  This  la  done  aa  follows: 

In  addition  to  Its  other  states,  the  Turing  machine  may  have  a 
state  called  "INTERROGATE."  When  the  machine  enters  this  state,  It 
asks  the  oracle  whether  the  number  currently  written  on  the  oracle 
tape  Is  a  member  of  the  oracle  set.  The  oracle  gives  Its  answer  by 
causing  the  machine  to  enter  either  of  two  different  states.  The 
oracle  tape  Is  then  automatically  erased,  the  oracle  tape  head  reset 
to  the  first  tape  square,  and  the  computation  Is  allowed  to  continue. 

Each  oracle  Turing  machine  may  be  described  by  a  flowchart  or 
some  other  finite  description.  The  machine's  description  la  Inde¬ 
pendent  of  the  particular  oracle  set  used,  so  the  same  oracle  machine 
may  be  used  with  any  oracle.  The  finite  descriptions  may  be 

enumerated  In  a  natural  way.  We  Identify  tp  ^  with  the  nth  machine 

n 

description  in  this  enumeration;  our  enumeration  is  "acceptable," 
and  so  there  is  no  notational  inconsistency  with  usage  In  [Rol], 

We  now  define  two  measures  on  this  machine  model: 

T^  \  time  measure 

(A) 

For  any  1,  x,  A,  we  define  T^  7  (x)  to  be  the  total  number  of  steps 

(  i.) 

executed  In  the  c^nputation  cp^  '  (x).  Here,  each  oracle  interrogation 
counts  as  a  single  step. 

It  is  clear  that  the  axioms  for  relative  complexity  are  satisfied; 
for  Instance,  to  discover  if  T  *A*(x)  -  y,  v(A)(<i.x,y>)  must  construct 
the  machine  cp^  \  then  simulate  cp|  A^(x)  for  y  steps  to  see  If  It 
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/ 


converges. 

S4  ' .  space  measure 

For  any  1,  x,  A,  we  define  S^^Cx)  to  be  the  maximum  of  the 
number  of  worktape  squares  visiter  and  the  number  of  oracle  tape 
squares  visited  during  the  computation  cp^  ^(x),  provided  that  cp^  (x)l. 
Otherwise,  we  let  S^^(x)  ■  00 . 

Axiom  (1)  is  satisfied  by  definition.  To  see  that  axiom  (2)  is 
also  satisfied,  we  note  that  for  any  i,  x,  y  and  A,  if  cp^A^(x) 
operates  for  (i)(iy)(y)(2y)(y)(log  x)  steps  without  exceeding  space 
y,  it  must  be  in  an  Infinite  loop  and  hence  will  not  converge.  This 
bound  arises  since  if  the  machine  is  ever  twice  in  the  same  state,  with 
the  same  worktape  contents,  the  same  worktape  head  position,  the  same 
oracle  tape  contents,  the  same  oracle  tape  head  position  and  the  same 
input  tape  head  position,  it  must  be  in  an  infinite  loop.  The  six 
factors  in  the  above  expression  represent  bounds  on  the  number  of 
different  possibilities  for  each  of  the  six  items. 

Thus,  to  see  if  S^^x)  -  y,  we  need  omly  simulate  cp^^x)  for 
(i)(ly)(y)(2y)(y)(log  x)  steps  to  see  if  it  converges. 

We  note  that  our  machine  model  has  linear  speed-up  [HLS]  for 
machines  that  don't  use  their  oracle  tapes.  That  is,  given  any  e  >  0 
and  any  such  machine  cp^^,  we  can  effectively  find  «Pj^  *  such 

that  for  all  sets  A,  €  *  ^  a.e. 

We  also  note  that  the  space  measure  has  the  following  property, 
sometimes  called  the  "parallel  computation  property":  [LR] 


/ 
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There  exists  a  recursive  function  T\  such  that  for  all  i  and  J, 

f «pi(x)  if  S^x)  S  SjCx) 

^(i,J)(X>  “  %  (x)  otherwise 

and  Sll(i,J)(x)  "  ®ln(Si<x),S](x))* 

This  property,  uhich  essentially  allows  us  to  re-use  the  same 
tape  squares  for  different  portions  of  a  computation,  often  makes  it 
very  easy  to  prove  theorems  for  the  space  measure.  It  also  causes 
some  results  for  space  measure  to  be  sharper  than  those  for  other 
measures.  We  will  point  out  such  cases  where  they  occur. 

Theorems  concerning  the  complexity  of  partial  recursive  functions 
[Bl]  [HHl  [McC]  all  have  straightforward  full  relativizations  with 
proofs  parallel  to  the  original  proofs.  For  example,  from  Blum’s 
speed-up  theorem  [Bl]  we  obtain: 

Proposition  2.4:  (relativized  speed-up  theorem) 

(VA) (Vs  €  R2(A))(M  «  n/*'.  £  0-1  valued) (VI) 

I(CPi<«  .  f)  =  •  f  ''•(x.»/A)W)  s  «1<A)W 

(That  is,  for  every  program  for  f  using  an  A-oracle,  there  is 
an  a.e.  much  faster  program  also  using  an  A-oracle.) 

The  proof  is  exactly  like  the  usual  proof  of  the  speed-up  theorem, 
using  a  relativization  of  the  recursion  theorem  in  place  of  the 
recursion  theorem  itself. 

Mote  Interesting  end  useful  are  partial  relatlvlr.tlone  of  the 
results  on  complexity  of  partial  recursive  functions.  Following  are 
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several  examples. 

Ouv  first  theorem  asserts  that  any  two  relative  complexity  mea¬ 
sures  are  related  by  a  fixed  recursive  function.  Its  usefulness 
lies  in  enabling  us  to  draw  conclusions  about  one  relative  measure 
from  hypotheses  about  another  relative  measure,  as  we  do  in  some  of 
the  results  following  the  theorem. 

Theorem  2.5;  (recursive  relatedness) 

If  ^  and  ^  ^  are  two  relative  complexity  measures  on  the 
same  acceptable  Godel  numbering  ^},  then  there  exists  r  e 

such  that: 

(VA.i)  *  r  o  a.e.  ] 

and  (VA,i)  [^A^  £  r  o  #^A^  a.e.]. 

Proof:  We  require  a  lemma  \Aiich  is  a  direct  consequence  of  Koaig’a 
lemma  ("Endlichkeitslemma,"  [Rol,Ex.  9-40])  and  \rtiich  will  be  used 
in  several  later  theorems  as  well. 


Lemma  2,3,1:  Suppose  we  have  a  recursive  function  f  of  k  integer 
variables  and  one  set  variable.  Suppose  that  f  is  total. 

Suppose  finally  that  (Vx^,...,x^)  [f ' (x^, . . . ,x^)  *  max  f (x^, . . . .x^jA)] 
Then  f'  e  1^. 


Proof  of  lemma  2.5.1:  The  computation  of  f ' (x^, . . . ,x^)  may  be  carried 
out  as  follows: 


Generate  a  "computation  tree"  for  the  function  fCx^ . . .  .x^A)  as 
A  ranges  over  all  subsets  of  N.  Each  branch  of  the  tree  must  terminate, 


/ 
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since  f(x^ . ^A)  converges  for  all  sets  A.  Therefore,  the  entire 

tree  is  finite  and  we  will  eventually  finish  generating  it.  We  can 
then  take  the  maximum  of  the  outputs  on  all  branches  as  the  value  of 

f 1  • 

Troof  of  theorem  2.5.  continued:  By  symmetry,  it  suffices  to  obtain 

r  i  Rj  satisfying  the  first  inequality. 

We  define  r(x,y)  ■  max  p(i,x,y),  vtoere 

iSx 

p(i,x,y)  -  max  p'(i,x,y,A),  and 
AQi 

(i .(A)(x)  if  $.(A)(x)  -  y 
p'(i,x,y,A)  -  < 

0  otherwise. 

p'  is  a  total  recursive  function  of  three  integer  variables  and 
one  set  variable.  Therefore,  by  lemma  2.5.1,  p  c  Thus»  r  * 

To  see  that  r  has  the  required  properties,  we  consider  a  par¬ 
ticular  A  and  i. 

If  ^(A)(x)  diverges,  the  inequality  holds  by  convention. 

If  £^A^(x)  converges  and  x  ^  i,  then: 

r(x,^(A)(x))  *  p*(i,x,^(A) (x),A) 

a  *  *A) (x),  as  required. 

QED 

Remark  2.5.2:  The  recursive  isomorphism  between  any  two  acceptable 
enumerations  of  relative  algorithms  (lemma  2.2)  allows  us  to  conclude 
the  recursive  relatedness  of  relative  complexity  measures  on  two 
different  enumerations.  Specifically,  we  obtain: 


\ 


"If  {q)i(  and  (Cp  ']  are  any  two  acceptable  enumerations  of 
relative  algorithms,  with  relative  complexity  measures  ^  and  ^ 
respectively,  then  there  exists  a  recursive  isomorphism  f  and  a 


function  r  e  R2  s-  ;h  that: 


(VA.l)  [«4W  sro  4f(1)<A)  *.«•] 

And  (TA,i>  (<f(1)<A>  ‘i(A> 

The  proof  is  a  simple  modification  of  the  proof  of  theorem  2.5, 
using  the  recursive  isomorphism  whose  existence  is  given  by  lemma  2.2.  i 


Theorem  2.5  and  remark  2.5.2  provide  an  alternate  method  to 
general  axiomatic  proof  for  certain  types  of  theorems  abbut  relative 
complexity  measures.  The  method  is  to  prove  the  theorem  for  one 
specific  measure,  and  then  apply  theorem  2.5  (or  remark  2.5.2)  to 

.  I 

obtain  the  result  for  all  measures.  We  will  use  this  new  proof 
method  in  some  cases;  as  an  example  of  its  use,  wo  give  the  following 

i  i 

corollary  to  theorem  2.5  and  remark  2.5.2.  1  , 

The  result  has  two  parts;  in  part  (1)  we  see  that  (Just  as  in  the 

» 

non-relativiaed  case)  there  exist  arbitrarily  complex  functions. 

i 

However,  in  contrast  to  the  non-relativiaed  case,  part  (2)  shows 

'  ..  1 

that  inherently  complex  functions  cannot  be  0-1  valued.  In  fact, 

i 

their  complexity  must  result  from  the  site  of  the  function  values. 

!  .  1  ! 

First,  a  definition:  1  i  , 

Definition  2.6:  Assume  B  is  a  set,  f  s  Rj  and  g  is  a  total  function 

of  one  variable.  !  ■ 


i 


I 


! 
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"Compv  '  f  >  g  i.o.  (a.e.)"  means 

(Vi)  PPi(B)  -  f  =*  «1(B)  >g  i.o.  (a.e. )  ]. 

"Comp^  f  ^  g"  means 

'  (3i)  ppt(B)  -  *  A  *t(B  *:  g], 

(B) 

"Comp'  ‘'fig  i.o.  (a.e.)"  means 

(3i)  ■  f  A  i  ^  Sg  i.o.  (a.e.)]. 

)  i  1  i 

i  1  , 

"Comp  f  >  g  *.o."  means 

i 

(0) 

Comp  f  >  g  i.o.,  and  similarly  for  the 

other  abbreviations.  , 

‘  ;  i 

If  f  ■  C.  for  some  set  A,  we  may  write  "Comp  A"  in  place  of 
A  | 

1  !  .  , 

"Comp  f."  ,  i  • 

.  i 

We  are  now , ready  to  stpte  and  prove  the  corollary: 

|  *  I* 

(  ) 

Corollary  2.5.3:  Let  $'  be  any  relative  complexity  measure.  Then: 

(1)  (Vf,  f  total) (3g,  g  total) (XA) 

t 

[Comp^  g  >  f  a.e. ] . 

(2)  (Vh,  h  total) (3f,  f  total) (Vg,  g  total) 

r(g  *  h  a.e.)  =*  (3A)  (Comp^A^g  £  f  ^.e.)]. 

i  1  i 

i 

Proof:  (1)  Let  r  be  the  function  obtained  by  applying  theorem  2.5 
to  ^  and  \  We  may1  assume  without  loss  of  generality  that  r  Is 

j 

monotone  nondecreasing  in  its  second  variable. 

Given  f,  let  g(x)  -  2r(x,f(x^  +  *.  i  , 

If  qp^A*  -  g,  then  clearly  (Vx)  rpr^A\x)  >  r(x,f(x))],  since  it 

1  requires  i(x,f(x))  +  1  steps  merely  to  output  the  result  in  binary. 

But  r(xt*,^(x))  *  t  (A)(x)  a.e.,  by  theorem  2.5. 

!  J  J 

Thus,  r(x,$,^(x))  >  r(x,f(x))  a.e. 
j 

$  ^(x)  >  f(x)  a.e.,  as  required. 

i  1  ^  t 

» 

I 

I 

k  ,  ,  i  '  I  ’ 
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If  the  relative  complexity  measure  #  }  is  on  an  enumeration 

of  relative  algorithms  other  than  oracle  Turii*  machines,  we  apply 
remark  2.5.2  in  place  of  theorem  2.5  and  obtain  the  same  result. 

(2)  Let  r  be  the  function  obtained  by  applying  theorem  2.5  to 

* ^  and  s^*  *8*in  chosen  to  be  monotone  nondecreasli^  in  Its 
sec^rad  variable. 

Assume  h  Is  given. 

Define  f(x)  -  r(x,x2  +  h2(x)). 

Now  consider  any  g  with  g  £  h  a.e. 

Let  A  -  (<*,g(x)>|x  €  N) . 

It  is  straightforward  to  design  a  machine  <p^  ^  such  that 
<Pj(A)-g  and  for  which  Sj(A)(x)  *  x2  +  h2(x)  a.e.  For  instance, 
the  machine  <Pj  on  argument  x  can  operate  by  successively  computit* 
<^,0>,  ^t,l>,  <x,2>,...,  and  asking  if  each  is  in  A.  If  so,  the 
machine  terminates  with  the  appropriate  output. 

2  2 

The  bound  x  +  h  (x)  results  from  the  particular  form  of  the 
pairing  function  used  [Rol,  $5.3J. 

But  then  fj^Cx)  £  r(x,Sj(A)(x))  a.e.,  by  theorem  2.5. 

*  r(x,x2  +  h2(x))  a.e. 

-  f(x). 

So  *(x)  4.  f(x)  a.e.,  as  required. 

As  in  (1),  if  the  relative  complexity  measure  ^  is  on  an 
enumeration  of  relative  algorithms  other  than  oracle  Turit«  machines, 
we  apply  remark  2.5.2  in  place  of  theorem  2.5  and  obtain  the  same 
result. 


QED 
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Informally,  corollary  2.5.2  shows  that  (1)  function*  oust  be 
a*  complex  as  their  site,  and  (2)  given  the  proper  oracle,  a  function 
need  be  no  sore  complex  than  Its  size. 

Henceforth,  whenever  we  use  this  new  sethod  of  proof,  we  will 
appeal  to  "recursive  relatedness";  It  will  be  understood  that  we 
Intend  this  to  sea n  we  are  applying  theorem  2.5  or  remark  2.5.2, 
whichever  Is  appropriate,  In  a  fashion  similar  to  that  used  In  the 
proof  of  corollary  2.5.3. 

The  non-relatlvlxed  compression  theorem  fBl)  asserts  the 
existence  of  a  recursive  "coapression  function"  h  such  that  whenever 
we  are  given  any  total  running  tine  we  can  obtain  a  0-1  valued 
function  not  computable  In  measure  £  but  conputable  In 
measure  s  ho  •  . 

Lessna  2.7  Is  a  relatlvlsatlon  of  this  result;  It  asserts  the 
existence  of  a  recursive  "compression  function"  h  such  that  whenever 
we  are  given  any  total  function  g,  we  can  obtain  an  oracle  set  B  and 
a  0-1  valued  function  not  computable  from  a  B-oracle  In  measure  g, 
but  computable  In  measure  ho  g. 

This  lemma  will  later  be  used  to  prove  theorem  3.6. 

Lerma  2.7:  Assume  we  are  given  a  relative  complexity  measure  $  \ 

Then  (3h  e  R2>(Vg,  g  total)  (3b, A) 

(1)  Corap^A  >  g  l.o. 
and  (2)  Comp^A  £  h  o  g. 


Proof:  Given  g,  we  define  B  •  (<x,g(x)>|x  e  K) . 


Define: 


CA00  - 


0  otherviae 


A  la  thua  defined  froai  I  by  a  diagonallaatlon  which  inaurea  that 
the  firat  condition  la  aatiafled.  To  verify  the  aecond  condition, 
ve  ouat  define  h. 

Firat,  define  a  relative  algorithm  q?1  (  '  aa  follova: 


1  -  <P 


(V*,X)  <?J(X)(>c) 


(x)  if  (3t)[<*,*>  C  X)  and 

£  w*f<it**>  c  XJ* 

if  <3*)f<k,i>  c  X)  and 

fni(K)<X>(*>  >M*f<x,*>  CX), 
othervlaa. 


(A  note  on  Chia  definition:  the  exiatence  of  the  relative 
algorithm  ♦  given  by  axiom  (2)  of  deflnitiot  2.3  iaaaediately  impliea 
that  the  teata  for  inequality  may  be  nmde  effectively  in  x  and  X.) 


Now  define  h(x,y)  •  max  h'<x,y,X),  where 

XCN 

K(X,<«>  if<*,y>cx, 

h*(x,y,X)  -  l  i 

0  othervlaa. 


h'  la  total  reerraive  in  x,  y  and  X,  alnce: 

<x,y>  C  %  - 

•  #<*>(,).,  by  axiom  (1). 


Therefore,  h  C  R^,  by  lmma  2.3.1. 


For  the  particular  g,  A  and  B  under  coneideratlon,  we  compare 
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the  definition  of  with  the  definition  of  9^  ^  end  conclude  the t 


e  (•)  .  c 

A* 


Aleo,  since  <*,g(x)>  c  1  for  ell  x,  it  folio-  thet: 
h(x,g(x))  S  h'(x,g(x),B) 

■  #<««  for  ell  x,  es  required. 


QED 


Remark:  We  note  thet  the  proof  of  lease  2.7  ectuelly  provides  e 
result  considerebly  stronger  then  thet  steted.  Namely, 

"(Vhj  CR2)(3h2  CR2)(Vg,  g  totel) (Vb) (3a) 
fComp^g  s  hj  o  g  e.e.  m  (1)  Comp^A  >  g  i.o.,  end 

(2)  Comp^A  s  h2  o  g  e.e.]." 

To  prove  this  result,  we  cen  either  modify  the  given  proof  of  lease 
2.7,  or  note  that  the  result  holdo  for  spece  measure  and  use  recursive 
relatedness. 

The  condition  "Comp^g  s  hj  o  g  e.e."  is  an  example  of  an 
"honesty  condition"  -  one  which  specifies  that  a  function  has  a 
running  time  which  is  approximately  equal  to  its  slse.  Honest 
functions  (a  generalisation  of  running  times,  as  we  will  later  show) 
are  extensively  studied  in  fMeMo). 


Honesty  conditions  will  turn  out  to  be  necessary  hypotheses 
for  many  of  our  later  theorems,  particularly  in  chapters  5  and  6. 
There,  for  simplicity  we  will  usually  require  that  a  function  be  a 
running  time,  whereas  a  less  restrictive  honesty  hypothesis  would 


have  been  sufficient. 
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In  1  r— *  2.7,  the  first  conclusion  may  be  sharpened  to  assert 
that  Comp A  >  g  a.e. ,  rather  than  merely  i.o.  This  is  done  by 
introducing  two  additional  tricks  into  the  construction. 

The  first  is  a  sharper  form  of  diagonaliaation  in  the  construction 
of  A  which  makes  g  an  a.e.  lower  bound  on  A's  complexity.  The  basic 
construction  is  due  to  Rabin  and  may  be  found  in  fHH). 

Rabin's  method  defines  CA  at  successively  larger  values  of  x,  in 
order.  Thus,  computing  CA(x)  for  any  x  requires  first  computing 
g(0),  g(l),...,  g(x).  In  order  to  keep  the  complexity  of  A  as  small 
as  possible,  we  introduce  the  second  modification,  due  to  B.um:  we 
compute  C.  on  arguments  not  in  order  of  site  of  the  arguments,  but 

A 

in  order  of  site  of  the  values  of  g. 

Since  both  of  these  ideas  will  be  used  in  the  succeeding  chapters, 
we  give  the  detailed  construction: 

Theorem  2.8:  Assume  we  are  given  a  relative  complexity  measure  \ 
Then: 

(3h  e  R2)(Vg,  g  total  and  g  s  \xfx])(3B,A) 

(1)  Comp^A  >  g  a.e., 
and  (2)  Coap^A  s  h  o  g 

Proof:  Given  g,  we  define  B  as  before. 

We  define  a  relative  algorithm  ^  as  follows: 

For  any  X,  y*X^  will  be  defined  in  stages;  thus,  to  compute 

/V\ 

y*X^(x),  we  begin  executing  stages  in  the  definition  of  y  until 


/ 
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the  value  of  y*'*  (*)  becomes  defined.  At  each  stage,  at  most  one 
additional  Integer  Is  added  to  the  domain  of  yxr* . 

During  the  construction,  an  Index  1  will  become  "cancelled" 
when  we  have  Insured  that  y 

(X) 

Stage  n  In  the  definition  of  vv  * : 

Find  the  smallest  Integer  y  for  which  there  exists  an  Integer 
x  *  y  such  that  y^(*)  was  not  defined  at  sn  earlier  stage  and 
<5c, y>  c  X,  and  for  this  y  the  smallest  x. 

(It  Is  possible  that  this  search  may  not  terminate,  In  which 
cas*  y^  will  diverge  at  all  arguments  for  which  It  has  not  already 
been  defined.) 

When  <x,y>  has  been  found,  we  find  the  smallest  uncancelled 
1  £  x  such  that  # ^  ^ (x)  £  y. 

T.f  no  such  1  exists,  define  y^  (x)  »  0. 

If  1  does  exist,  define  y**\x)  -  1  ^^^(x)  and  cancel  1. 

In  either  case,  go  on  to  stage  n  +  1. 

EH)  OF  CONSTRUCTION 

Verification:  We  let  A  be  a  set  such  that  y^  ■  C^.  (This  Is 
possible  since  y^  1*  0-1  valued  and  total.) 

We  claim  Comp^A  >  g  a.e. 

For  If  not,  then  for  some  1,  and  4^®^ 


*  g  l.o. 


t 
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But  after  some  -stage  n  in  the  construction  of  y  *  *  C,,  all  the 

A 

indices  smaller  than  i  which  ever  get  cancelled  have  already  been 
cancelled.  But  for  some  x  such  that  C^(x)  is  defined  after  stage  n, 

*t(B)(x)  *  g(x), 

so  th*.c  we  will  define: 


CA00  ■  1  -  qDj  '(x),  a  contradiction. 


To  verify  the  second  conclusion,  we  choose  j  such  that  cp ^ 
define  h  and  proceed  exactly  as  in  the  proof  of  lemma  2.7. 


(  ) 


y<\ 


QED 

Remark:  As  for  lemma  2.7,  the  property  of  B  that  we  actually  require 
in  this  theorem  is  that  B  makes  the  function  g  honest  (i.e.  g  can  be 
computed  from  a  B-oracle  within  measure  approximately  equal  to  g) . 

We  can  thus  obtain  the  more  general  result: 

"(V^  e  R2)(3h2  e  R2)(Vg,  g  total  and  ^  \xfx])  (Vb)  (3\) 
fComp(B)g  £hjO  g  a.e.  =*  (1)  Comp(B^A  >  g  a.e.,  and 

(2)  Comp^A  £  h2  o  g  a.e.]" 


A  formal  proof  of  this  remark  uses  techniques  wo  have  not  yet 
developed,  namely  a  method  of  proof  we  will  call  the  "domain-of- 
convergence  method."  In  Chapters  4  through  6  we  will  discover 
ourselves  repeatedly  using  this  type  of  method  to  prove  theorems. 

A  restricted  form  of  the  idea  of  domaln-of-convergence  arguments 
may  be  stated  in  the  form  of  a  lenna,  a  relativizatlon  of  the 
combining  lemma  fHH).  The  statement  of  a  lemma  sufficiently  general 
to  imply  all  the  later  results  is  necessarily  cumbersome;  we  will 
therefore  present  it  in  something  less  than  its  full  generality. 


/ 


/ 
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In  the  form  of  lemma  2.9  below,  the  relativised  combining 
lemma  implies  some  of  the  later  results  (corollary  2.9.1,  lemma  4.7, 
lesma  6.2.1).  Several  others  (theorems  4.8,  6.3)  will  use  essen* 
tially  similar  methods. 


The  lesma  relates  the  complexity  of  a  computation  to  the 
complexity  of  its  subcomputations.  As  in  TRol,  ^  5.6],  we  let 
represent  the  finite  set  with  canonical  index  k. 


Lesma  2.9:  (combining  lesma) 


(  ) 


Assume  we  are  given  a  relative  complexity  measure  and  a 

function  c  e  Buch 

(’flI . 1m»^l»^2,x,A^ 

t(Wl  (A)(x)l  A  ...  A  c p  (A)(x)l  Ac p  (Dj2)(x)l) 

1  m  J1 

"  <">c«  1  .  I 

Then  there  exists  g  (  R^  such  that  for  all  A, 

g(x,max(»  (A)(x) . (A)(x),¥  ^J.^(x))) 

1  m  J1 

56  •  4  4  4  (*)• 

c(il,...,iin,Jl,J2) 


Proof: 

Note:  This  proof  is  still  valid  if  j  and  k  are  eliminated,  or  it  c  is 
also  a  function  c t  additional  parameters  which  don't  affect  the 
convergence  implication. 

Define  g(x,y)  -  max  g'(x,y,i.,...,i  ,J.,J2)» 

ik*x  for  kin,  J^x,  J2*x 

where  g'(x,y,i . i»J,»Jo)  -max  g"(x,y,i 

1  m  1  1  A=N 


1  *  *  *  *  1  2,A^  * 
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\n  .  .  /A)(x)  if  (Vk  Sta) 

C(11 . ‘-’JI’V  (A) 

[9  (A)  Sy], 

Lk 


gn  (x»y  » •  •  •  -1 1 » $2  *  a)  "  j 


and 


(D*  ) 


JiWJ2,(x)  *  y 


otherwise. 


It  Is  easily  seen  that  g"  Is  total  recursive  In  m  +  4  Integer 
variables  and  1  set  variable.  Therefore,  by  lemna  2-5.1.  8’  «  W 
so  that  g  €  R2> 


To  see  that  g  has  the  desired  properties,  we  note  that  if 

x  max  . lm,J1,J2)»  then: 

g(x,max{*.  ^(x) . 9.  ^(x),$,  ^DJ,^(x)l)  * 

ll  m  J1 

g" (x,®®x( f .  (A^(x) . *.  (A^(x),$.  ^DJ2^(x)},1. . 

ll  m  J1  1 

1m,^l,J2»A^ 

•  9  .(A\x),  as  required. 

c*ll . 1m,Jl,J2; 


QED 


As  a  simple  example  of  the  use  of  lemma  2.9,  we  give  the  following 

corollary.  The  result,  a  relatlvlzatlon  of  the  compression  theorem, 

Is  closely  related  to  lemna  2.7.  Here,  however,  we  fix  the  oracle 

(B) 

set  B  In  advance  and  work  with  B-recurslve  functions  cp^  ,  whereas 
In  lemna  2.7  we  work  with  any  total  function  g  and  find  a  set  which 
makes  g  honest. 


Honesty  Is  relevant  for  this  corollary  as  well.  We  begin  with 
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any  B-recursive  function  cp^  ,  but  we  only  obtain  a  set  A  with 
complexity  approximately  equal  to  *  ^B*(a  B-honest  function)  rather 
than  cp^®\ 


Corollary  2.9.1:  Assume  we  are  given  a  relative  complexity  measure  f  ^  \ 

Then  (3h  C  R2)(VB)(Vi,  qp^8*  totalKSA)  such  that: 

rnmn(S)A  .  „  (B) 

Comp  A  >  cp^  i.o. 

and  Comp(B)A  <  h  0  #t(B)  a.e. 

Proof:  We  define  a  relative  algorithm  y ^  ^  as  follows: 

For  all  i,  x,  B, 


Y(B)(<i,x>)  -  < 


1  -  » 


^(x) 


(B)(x)  if  cp/B)(x)i  and 


if 


«P1^B)(x)4 


and 


(B>, 


(B), 


Vx>  (x)>v  (x>- 

(B) , 


if  «p£  (x)t. 


By  the  relativized  s-m-n  theorem,  there  exists  c  f  such  that 


Y(B)(<i,x>)  -  cpc(1)(B)(x). 

(B), 


Now  it  is  clear  that  (Vi,x,B)[cp/D/(x)J  =»  cp  (B)(x)*]. 

l  c(i) 


We  may  now  apply  lemma  2.9  and  assert  that: 


<*>  (3H  C  R2)(Vi,B)[h(x,#1(B)(x»  a  *c(1)W(x>  a.e.]. 

We  now  fix  i  and  B  as  in  the  hypotheses,  and  let  C.  -  cp  .  .^B\ 

A  C  (i) 

This  is  possible  since  the  hypotheses  imply  that  cp 


(B), 


c(i) 


(B) 


is  0-1 


valued  and  total 
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By  the  diagonal  construction  defining  it,  C.  satisfies  the 

A 

first  conclusion;  the  second  conclusion  follows  from  (*). 

QED 

Many  of  the  interesting  pcrtial  relativizations  of  the  speed-up 
theorem  [Bl]  may  be  expressed  in  terms  of  "helping";  we  discuss  in 
these  terms  the  amount  by  which  possession  of  an  oracle  speeds  up  the 

computation  of  a  function.  This  type  of  question  forms  the  subject 
matter  of  Chapters  4,  5  and  6. 

A  relativization  of  the  union  theorem  [McC]  will  be  given  in 
Chapter  3,  together  with  some  interesting  consequences. 
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3.  Complexity-Determined  Reducihllities 

Just  as  we  study  complexity  classes  within  non-relativized 
complexity  theory  [McC]  [McCMe],  we  may  consider  resource-bounded 
relative  computation.  A  fixed  resource  bound  defines  a  kind  of 
"reducibillty"  as  follows: 

Definition  3.1:  For  any  relative  complexity  measure  \  any  sets 
A  and  B,  and  any  total  function  f  of  one  variable, 

"A  ^  B  (#'  ')"  means  Comp'  ;A  S  f  a.e.,  where  complexity 

Is  measured  In  \ 

More  generally.  If  C  Is  any  class  of  total  functions  of  one 
variable , 

"A  s=c  B  («(  ))"  means  (3f  cC)[A  *f  B  (#(  })] 

We  read  this  notation  as  "A  Is  f-reduclble  to  B"  and  "A  Is 
C-reduclble  to  B,"  respectively.  When  no  confusion  Is  likely,  we 
omit  mention  of  the  measure  we  are  using,  and  write  simply  "A  ^  B" 
and  "A  B. " 

Several  commonly-studied  reduclbllltles  usually  defined  via 
"natural"  (l.e.  non-complexlty-theoretic)  restrictions  on  the  method 
of  computation  may  be  expressed  as  C-reduclbilltles  for  appropriate 
choices  of  the  class  C,  and  thus  may  be  regarded  as  complexity- 
determined.  In  particular,  truth-table  reducibillty  [Rol]  and  the 
relation  "primitive  recursive  In"  are  complexity-determined 
reduclbllltles,  while  many-one  and  one-one  reduclbllltles  are  not. 

We  first  consider  primitive  recursive  reducibillty.  We  write 

"A  ^  B"  to  Indicate  that  A  Is  primitive  recursive  in  B,  and  "f  £  B" 
P  P 
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to  Indicate  that  f  Is  primitive  recursive  In  B  [K], 


Theorem  3»2;  Let  C  =  {primitive  recursive  functions  of 


one 


variable).  Then  (VA,B)[A  £  b  « 

P 


A  B  (T(  h). 


Proof:  We  use  the  type  of  T-predlcate  used  by  Davis  [D],  modified 
slightly  for  our  Turing  machine  model. 

1 

As  in  [D],  we  see  that: 

(VB)[\z,x,y[T  (z,x,y)]  is  primitive  recursive,  in  B]. 

An  examination  of  the  encoding  used  in  the  T-predicate  shows 
that  there  exists  f,  a  primitive  recursive  function  of  three  variables, 
such  that : 

(VB,w,x,y,z)[(Tz(B)(x)  *  x)  =»  (3y  *  f (z,x,w))[TB(r ,x,y)] ] . 

:  ,  i 

(That  is,  some  code  number  for  the  computation  is  effectively  bounded 

i 

by  a  function  of  the  number  of  steps  in  the  computation,  the  input  and 
the  index  of  the  machine.) 


We  now  define,  for  every  set  B,  a  function  gfi  of  three  variables 
as  follows:  (Notation  is  from  [K].) 

J  U(py  £  f (z,x,w)[TB(z,x,y)] )  if  y  exists 
>x,w)  =  <  !  , 

0  otherwise 


«B<Z 


(Intuitively,  gB(z,x,w)  represents  the  output  of  the  computation 
®t(B)(x),  provided  Tz(B)(x)  *  w.) 


gB  is  obviously  primitive  recursive  in  B,  for  any  set  B. 


Now  assume  we  have  sets  A,  B  with  A  s  B.  This  implies: 


/ 


I 


(3i,  3h  a  primitive  recursive  function  of  one  variable) 
f(?A  7<Pi(B))  A  (Vx)(^(B)(4  ^l»(x)]].  • 

i 

(  »  , 

Then  the  definition  of  gn  shows  that  C.  =  \xfg0(i,x,h(x)) ),  and 

o  Ad 

the  function  on  the  right-hand  side  of  this  equation  Is  primitive 
recursive  in  B*  1 


!  1  I 

The  converse  Is  proved  using  the  following  lemma: 

’  i  : 

I 

Lemma  3.2.1:  (VB)(Vf)f(f  s  b)  =»  (3p,  a  primitive  recursive  function) 

-  i  p 

rp  *  fjj. 

!  ! 

(That  Is,  any  function  primitive  recursive  In  any  set  Is  no  larger  than 

1  ,  .  ,  •  1 

some  primitive  recursive  function.) 

Proof  of  lemma  3.2.1:  Me  carry  out  a  straightforward  proof  by  Induction 

t 

on  the  definition  of  the  class  of  functions  primitive  recursive  in  B. 


In  particular,  C'  £  \xfl),  which  is  primitive  recursive.  The 
B 

other  base,  functions  for  the  induction  are  themselves  primitive  recursive. 

i 

.  ,  i 

i  '  i 

The  two  induction  steps  (composition  and  recursion)  follow  without 

! 

»  * 

difficulty  if  we  note  that: 

1  i 

(Vf,  primitive  recursive) (3f' ,  primitive  recursive)1 

I 

f (f *  s  f)  A  (f'  is  monotone  increasing  in  each  of  its  variables)] 

i 

.'For  example,  we  verify  the  recursion  step: 


Assume  that  h  is  a  function  of  k  +  1  variables  with  h  £  B. 

P 

Assume  that  g  is  a  function  of  k  -  1  variables  with  g  £  B. 

P 


i 


! 


I 
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Assume  h  £  and  g  s  where  p^  end  are  each  primitive 
recursive  and  monotone  increasing  in  each  variable. 

Assume  a  function  f  is  defined  by  primitive  recursion  from  g  and  h: 
(We  write  "x"  to  Indicate  "x^ . x^.") 

f  (0*x)  -  g(x) 

(Vy)  f(y+l,x)  -  h(y,f(y,x),x) 

Now  define  p^  as  follows: 

Pj  (0,x)  -  pg  (x) 

(vy)  pf(y+i.x)  -  ph(y,pf(y,x),x) 

It  is  easy  to  verify  that  pf  is  primitive  recursive  and  f  £  pf, 
as  required. 

Proof  of  theorem  3,2,  continued: 

We  again  use  induction  on  the  class  of  functions  primitive  recursive 

in  B. 


An  oracle  Turing  machine  with  a  B-oracie  can  obviously  compute 
CB  rapidly.  In  particular, 

(3i)(3p,  a  primitive  recursive  function)  f  (p.  ^  -  C_)  A  (T  *£  p)]. 

The  other  base  functions  are  primitive  recursive,  and  so  are 
computable  in  primitive  recursive  time.  [C] 

The  two  induction  steps  are  straightforward;  we  verify  the 
primitive  recursion  step,  leaving  the  composition  step  to  the  reader; 


3.2.1.  A* 
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Assume  we  have  f,  g  end  h  es  In  Che  proof  of  ler 
Inductive  hypothesis,  we  assume: 

-  g)  A  (rt(,)JP|)| 

end  <3J) fepj<B)  -  h)  A  (TJ<i)  <  pfc)l 
where  pg  end  ph  ere  primitive  recurelve  end  monotone  lnereeelng  In 

eech  verleble. 

By  lemae  3.2.1,  there  exlete  f',  e  primitive  recurelve  function 
euch  thet  f  i  f'. 

We  define  e  primitive  recurelve  function  pe  ee  follower 
pf(0,x)  -  pg(x) 

(Vy)  pf(y+i,x)  -  Pf(y,*>  +  p^y.f'ty.*).*) 

We  cleln  thet  the  primitive  recurelve  function  Pf  +  +‘ • *+  \  +  y 

le  en  upper  bound  for  the  time  required  to  compute  f.  If  further  detelle 
on  thle  Induction  etep  ere  deelred,  eee  fCJ,  fAl),  fRD),  rRRW)  or  'MeRD). 

Corollerv  3.2.2:  Theorem  3.2  le  true  for  S*  *  In  piece  of  T*  . 

Proof:  ^  end  ^  ere  releted,  In  the  eenee  of  theorem  2.5,  b^  e 

primitive  recurelve  function,  ee  we  cen  ehow  by  en  ergument  elraller  to 
the  looping  ergument  In  the  dlecueslon  of  ^  In  Chepter  2. 

Remark:  Theorem  J.2  Is  felee  for  some  pathologlcel  measures. 

We  now  consider  truth-table  reduclblllty  fRolJ.  A  result  of 
McLaughlin  fMcLj  combined  with  theorem  2.5,  gives  the  following 
complexity-determination  result  for  truth-table  reduclblllty: 
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Proposition  3.3:  Fix  any  relative  complexity  measure. 

Let  2  »  R,  Then: 

(VA,1)  fA  Sfct  B  •  A  B). 

On  the  other  hand,  rcany-one  and  one -one  reduclbllltles  are  not 
detenained  by  a  complexity  restriction,  in  any  relative  complexity 
measure.  The  reason  Is  that  there  are  paira  of  sets  computable  from 
each  other  in  a  very  6aall  amount  of  resource  but  which  are  not  many- 
one  reducible  to  each  other  (for  example,  any  nonrecursive  recursively 
enumerable  set  and  its  complement).  Thus,  for  natural  measures,  it  la 
obvious  that  many-one  and  one-one  r  ^uclbllltles  are  not  complexity- 
determined.  For  general  measures,  however,  a  little  work  la  required: 

Proposition  3.4:  Fix  any  relative  complexity  measure.  Let  C  be  any 
class  of  total  functions  of  one  variable.  Then  It  cannot  be  the  case 
that: 

(VA,B  e  fA  B  •  A  B]. 

Proof:  Assume  the  contrary:  let  C  determine  many-one  reduclblllty 
for  measure  \ 

By  consideration  of  T^  ^  and  remark  2.5.2,  we  see  that: 

(3s  e  R1)(3l)fCP1(K)  -  CR)  A  (#1(K)ss)). 

But  K  *  K,  so  that  (Vc  eC)fc(x)  <  s(x)  l.o.  ]. 
m 

To  obtain  a  contradiction,  It  suffices  to  show  that: 

(3a,B)  f  (A  B)  A  (Comp(B\  >  s  a.e.)] 

But  this  follows  from  the  following  lemma: 


( 


/ 
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Now  select  any  Infinite,  cotnflnlte  recursive  set  B,  end  use 
leans  3.4.1  to  obtain  an  appropriate  set  A.  We  can  easily  obtain  A 
Infinite  and  coinfinite,  and  so  A  B.  But  Conp^A  >  s  a. a.,  giving 
the  desired  result. 

QED 

Corollary  3.4.2;  Proposition  3.4  is  true  for  one-one  reduciblllty  In 
place  of  many-one  reduciblllty. 

Proof:  Implicit  In  the  proof  above. 

Open  Question:  Is  It  true  that: 

(Vs  C  Rj)(Vb  Infinite  and  coinfinite)  (3A  B) 
fComp^^A  >  s  a.e. )  ? 
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Having  shown  that  primitive  recursive  and  truth-table  reduci- 
bilities  are  complexity-determined,  we  ask  if  it  is  possible  to  ex¬ 
press  them  even  more  succinctly;  for  instance,  is  it  possible  to 
characterize  each  by  a  single  resource  bound  function  rather  than  a  class 

of  functions? 

This  question  imnediately  suggests  that  we  would  like  an  analog 
to  the  union  theorem  fMcC],  and  so  we  prove  the  following: 

Theorem  3.5:  (relativised  union  theorem) 

Assume  we  have  a  sequence  of  total  functions  (t^J,  with. 
(Vi,n)ft1+1(n)  *  tt(n)]. 

Let  T  be  a  set  such  that  Xi.nft^n)]  is  recursive  in  T. 

Also  assume  that  we  have  &  sequence  (B^)  of  sets,  and  a  set  B 
such  that:  M,nfCB  (n)  ]  is  recursive  in  B. 

Then  there  exists  a  function  f  C  ^  '  such  that: 

*  f  a.e.)  *»  (3k)(*1(BJ)  *  a.e.)]. 

(This  means  that  for  any  Bj,  the  class  of  functions  computable 
with  oracle  Bj  within  measure  f  is  exactly  the  union  of  the  classes  of 
functions  computable  with  oracle  Bj  within  measure  t^»  the  union  being 
taken  over  all  t^.) 

Proof:  The  construction  of  f  is  carried  out  in  stages,  with  f(n) 
being  defined  at  stage  n. 

We  define  an  auxiliary  function  g(i,J),  whose  values  may  be  changed 
at  successive  stages.  The  significance  of  g(i,J)  is  *s  follows: 

We  "guess"  that  S^VoO  *  ^(ij) 


(x)  a.e. 


Stage  n:  (Define  f(n).) 
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For  all  (i,J)  sur.'n  that  i  +  J  -  n,  define  g(i,J)  -  n. 


Let  E  -  C  (i»  J)  I  i  +  J  s  n  «nd  $1(BJ)(«)  >  fcg(if  j)^) 


Define: 


f(n)  *=-  < 


V"5 


if  E  -  0 


min  t  , v  (n)  otherwise. 
(i,j)es 


For  all  (i,J)  e  ”  redefine  g(i,J)  ■  n. 
Go  on  to  stage  n  +  1. 

END  OF  CONSTRUCTION 


Verification: 

Assume  we  have  i.  J,  k  and  we  know  that  ^  t^  a.e.  We  would 

like  to  conclude  that  f^V  *  f  ».e. ;  it  therefore  suffices  to  show 
that  (VkHt^  s  f  a.e.]. 

If  not,  then  for  some  k  we  have  f(n)  <  t^n)  °®  infinitely  many 
arguments  n  >  k. 

At  stage  k,  there  can  only  be  finitely  many  pairs  (i,J)  with 
g(l,J)  <  k.  We  let  F  be  this  finite  set  of  pairs.  After  stage  k, 
no  pair  (i,J)  ever  has  g(i,J)  become  defined  to  be  less  than  k.  There¬ 
fore,  if  g(i,J)  <  k  at  some  stage  after  stage  k,  we  know  that  (i,J)  e  F. 

Now  if  f (n)  <  tfc(n)  on  infinitely  many  arguments  n  >  k,  then  for 
these  n,  f(n)  is  defined  to  equal  tg(1>J)(n)  for  some  (i,J)  e  F  with 
g(i»J)  <  k.  But  then  at  stage  n,  g(i,J)  is  redefined  to  equal  n. 


/ 
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‘■ince  F  is  s  finite  set,  this  can  only  occur  finitely  often 
before  no  pairs  (i, j)  remain  with  g(i,j)  <  k. 

Therefore,  we  have  (Vi,j) 

r(3k)($1(Bj)  £  a.e. )  ■*  ($1(Bj)  s:  f  a.e.)] 

Conversely,  assume  we  have  (i,j)  with  (VkH^'V  >  t^  i.o.]. 

Then  each  time  we  define  g(i,j),  we  will  subsequently  reach  a  stage  n 
where: 

*1  J  (n)  > 

At  this  stage  n,  (i,j)  will  be  in  ret  E,  so  the  definition  of 
f  will  insure  that  #t(V(n)  >  f(n).  We  will  also  redefine  g(i,j). 

But  it  is  easy  to  see  that  this  must  happen  for  Infinitely  many 
arguments  n,  so  that: 

$1(Bj)  >  f  i.o. 

Thus,  we  have: 

(Vi,j)  r(Vk)($1(Bj)  >  i.o.)  =>  (§t(V>f  i.o.]. 

It  is  clear  that  f  is  recursive  in  B  join  T. 

QED 

We  now  apply  theorem  3,5  to  the  cases  of  truth- table  reducibility 
and  primitive  recursive  reducibility. 

Corollary  3.5.1:  Consider  any  countable  collection  of  sets  {B^}  with 
B  as  in  theorem  3.5.  There  exists  f  e  R^B  such  that: 

(Vi,A)r  A  *tt  B1  «  A  Sf  B1]. 

Proof:  We  define  a  sequence  { t^}  as  follows: 


/ 
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Let  t.  (x)  *  max  {<?>.(x)|<p  (y)  1  tor  all  y  *  x}  if  this  set  is 
\  j^i  J  J 

nonempty 

0  otherwise 

These  t^  have  the  properties  required  for  theorem  3.5,  with 
T  -  K. 

Also,  (Vr  e  R1)(3j)[r  *  t^  a.e.  ] 

(Vj)(Sr  e  Rx)  rtj  *  r  a.e.] 

Thus,  by  proposition  3.3,  if  C  =  { t^} ,  then 
(VA,B)  fA  «tt  B  «  A  seB]. 

Application  of  theorem  3.5  now  gives  the  desired  result. 

QED 

Corollary  3.5,2:  Assume  we  are  working  with  or  T^.  Consider 

any  countable  collection  of  sets  ( B±) ,  with  B  as  in  theorem  3.5.  There 
exists  f  e  such  that: 

(Vi, A)  [A  ^  Bt  »  A  Bj ). 

Proof:  Let  (p^)  be  an  enumeration  of  the  primitive  recursive  functions 

such  that  Xi.xfp^x)]  is  recursive.  Then  define: 

t  (x)  =  max  p.(x). 

1  j£i  J 

(t^  satisfies  the  required  properties  for  theorem  3.5,  with 

T  =  0. 

Clearly,  (Vi) fp^  £  t^  a.e.],  and 
(Vi)(3j) ftt  *  Pj  a.e.]. 
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Applying  theorems  3.2  and  3.5  gives  the  desired  result. 

QED 

Thus,  we  see  that  for  any  countable  collection  oil  oracle  sets 
(e.g.  recursive  sets,  arithmetical  sets),  truth-table  reducibility 
is  determined  by  a  single  resource  bound  function  on  any  measure,  and 
primitive  recursive  reducibility  is  determined  by  a  single  resource 
bound  function  on  measures  ^  and  \ 

The  next  question  we  consider  is  whether  any  single  function  can 
determine  either  of  these  two  reduciblllties  on  all  pairs  of  sets. 

This  we  show  to  be  impossible;  thus,  the  countability  hypothesis  in 
corollaries  3.5.1  and  3.5.2  cannot  be  eliminated. 

Theorem  3.6:  There  is  no  function  f  of  one  variable  such  that: 

(VA,B  recursive  in  f)  f  A  stt  R  «*  A  *f  B], 

Proof:  Assume  such  a  funr.cion  f  exists. 

We  claim  that  (Vr  e  Rp  ff  >  r  a.e.  ]. 

For  if  not,  then  (3r  e  RJ) [r  *  f  i.o.J. 

But  then,  by  Rabin's  diagonal  method,  there  exists  a  recursive 
set  A  such  that  Comp  A  >  r  a.e.  We  have  A  s  0,  since  A  is  recursive, 
but  clearly  -i(A  £f  0) ,  a  contradiction. 

Now  consider  the  function  h  whose  existence  is  asserted  in  lemma  2.7. 
We  may  assume  without  loss  of  generality  that  h  is  monotone  Increasing 
in  both  variables. 


Define  a  function  g  as  follows: 
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g(x)  =  Jmaxtylh(x’y>  *  f(x))  lf  the  set  is  nonempty 
(  0  otherwise 

We  claim  that  (Vr  e  Rj) Tg  >  r  «.e.].  This  is  easily  concluded 
from  the  facts  that  (Vr  e  Rj) ff  >  r  a.e.]  and  that  h  is  recursive. 

We  now  apply  lemma  2.7  to  obtain  A  and  B  such  that: 
f(A  B)  A  -*A  B)]. 

But  (A  ^hQg  B)  implies  (A  B)  since  ho  g  «;  f  «.e. 

“|(A  B)  implies  -<A  B) ,  since  g  is  almost  everywhere 
greater  than  each  recursive  function. 

Thus,  f  does  not  determine  truth-table  reducibility  on  all  pairs 
of  sets. 

QEO 

IhCOrem  3-7:  A“u”'  «  «c  working  with  ,p.c«  on  or,cle 

Turing  machines.  There  is  no  function  f  of  one  variable  such  that: 
(VA,B)fASpB  »  A  S{  B], 

Proof:  The  proof  is  analogous  to  that  of  theorem  3.6: 

We  claim,  if  such  an  f  exists,  that: 

(Vr,  primitive  recursive  in  one  variable) Tf  >  r  a.e.]. 

For  if  not,  then: 

(3r,  primitive  recursive  in  one  variable) Tf  $  r  i.o. ].  We  may 
assume  without  loss  of  generality  that  r  is  monotone  nondecreasing. 

But  then,  by  a  Rabin  diagonaliaation  argument,  there  exists  a  recursive 
set  A  such  that  Comp  A  >  r  a.e. 
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However,  by  a  result  of  Cobham  fC]  and  an  examination  of  the 
dlagonalisation,  we  see  that: 

(3i)(3s,  primitive  recursive  of  one  variable)  Rp^  “  CA  A  st  =£  s  a.e.]. 

We  thus  have  A  £  0,  but  — i(A  0). 

P  f 

If  we  let  ^  ^  In  lemma  2.7,  It  Is  possible  to  obtain  a 

function  h  satisfying  the  conditions  of  the  lemma  which  Is  primitive 
recursive.  We  construct  B  and  A  as  In  lemma  2.7,  and  define  g  as  In 
the  proof  of  theorem  3.6. 

As  before,  we  obtain: 

(Vr,  primitive  recursive  In  one  variable)  Tg  >  r  a.e.]. 

Thus,  as  before,  A  B  A  -i(A  £  B). 

Therefore,  f  does  not  determine  primitive  recursive  reduclbllity 
on  all  pairs  of  sets. 

QED 

Remark:  An  analogous  proof  also  holds  for  T^  ^  In  place  of  K 

Open  Question:  Is  theorem  3.7  true  for  all  Blum  measures? 

Open  Question:  Examine  other  natural  reduclbllltles,  such  as  bounded 
truth-table  reduclbllity,  or  any  of  the  others  mentioned  In  TJl],  to 
see  If  any  are  complexity-determined. 

We  have  seen  that  some  reduclbllltles  with  "natural"  definitions 
may  be  alternatively  described  by  a  complexity  restriction.  Conversely, 

It  Is  possible  to  define  new  reduclbllltles  by  a  complexity  restriction. 
In  the  remainder  of  this  chapter,  we  give  an  example  of  such  a  definition, 
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and  examine  some  properties  of  the  resulting  reducibilities. 

Definition  3.8:  For  any  sets  A,  B,  C,  we  say  "A  is  C-reducible  to  B" 

(A  B)  provided: 

A£^B  for  C-R^^. 

We  write  "C-reducibility"  to  indicate  {(A,B)|a  ^  B} . 

Thus,  any  set  C  determines  a  new  reducibility,  namely,  the 
collection  of  pairs  of  sets  computable  from  each  other  in  C-recursive 
measure.  The  reducibilities  are  clearly  measure- invariant,  by 
theorem  2.5  and  remark  2.5.2. 

Strictly  speakit®,  anything  we  call  a  "reducibility"  ought  to  be 
reflexive  and  transitive,  properties  which  do  not  hold  for  general 
classes  C  .  However,  our  C -reducibilities  are  reflexive  and  transitive 
reflexivity  is  clear,  for  any  C.  We  demonstrate  transitivity: 

Lemma  3.9:  For  any  sets  A,  B,  C  and  D, 

[(A  B  A  BSCD)  *  A  £c  D]. 

(O 

Proof:  By  measure  invariance  of  C-reducibility  and  closure  of 
under  finite  modification,  we  obtain: 

(3i)(3Cl  SR1(C))fCA  -qPt(B)  A  Si(B)  *  Cl],  and 

(3j)(3c2  eR1(c))fCB  =<Pj(D)  A  S  W  *  c2). 

We  describe  an  oracle  Turing  machine  which  computes  CA  using 
a  D-oracle: 

(E) 

The  Turing  machine  computes  CA  according  to  procedure  <Pi  ,  but 
the  values  about  which  we  query  the  B-oraele  get  written  on  a  second 
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track  of  the  worktape  instead  of  the  oracle  tape.  Then,  to  decide 
their  membership  in  B,  we  use<pj^^»  with  our  D-oracle. 

i 

How  much  space  is  required  by  this  new  machine? 


For  input  x,  the  machine  uses  Si(B)(x)  to  carry  out  the  computation 
(x).  In  addition,  the  largest  argument  for  which  we  might  need 


<P 


(B) 


c  (B),_x 

to  compute  CB  is  2  i  v  so  we  might  also  require: 

Sj(D><0),  . 

Thus,  the  space  needed  is  bounded  above  by  the  maximum  of: 

. Sj<D><2Si<B)W), 

which  is  bounded  above  by  the  maximum  of: 


Cl(x),c2(0),...,c2(2Cl(x)). 


But  this  maximum  is  a  function  in  R 


(C) 


Thus,  A  D. 

i 

We  remark  that  results  similar  to  theorems  3.6  and  3.7  may  be 
obtained  for  these  reducibilities  as  well. 


QED 


There  are  simple  relationships  between  these  reducibilities  and 
others: 

Proposition  3.10:  '  (a)  For  any  set  C,  A  B  =»  A^B  =»  A  ^  B. 
(b)  If  C  is  a  recursive  set,  A  B  «  A  B. 


Proof:  Immediate  from  proposition  3.3. 


i 
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We  would  like  to  have  a  structural  description  of  C-reducibility 
as  an  alternative  to  the  complexity  definition.  -'We  obtain  the  following 
partial  result  in  this  direction: 

i 

Remark  3.11:  Assume  C  £  B.  Then  (VA) 

A  °  (iif  e  Rj^C^)fx  e  A  »  tt-condition  f(x)  is  satisfied  by  B] 

(For  notation,  see  [Rol]).  . 

f  i 

(This  says  that,  provided  the  oracle  set  has  a  sufficiently  high 

l  * 

degree  of  unsolvability,  any  reducibility  of  our  type  may  be  described 

■  i  .  i  i 

by  the  ability  to  construct  a  truth  table  for  the  computation  with  the 
help  of  the  appropriate  oracle.) 

i  i 

i  i 

Proof:  (=*)  Similar  to  McLaughlin's  proof  fMcp].  The  condition  C  £  B 

l  1  C 

is  not  needed  for  the  proof  in  this  direction. 


.  (♦■)  We  assume  that  C  B,  specifically,  that  : 

Cc  =<pi(B)»  $i(B)  s  «  where  8  e  RX(C). 

i 

i  i  1 

We  assume  also  that: 

Tx  e  A  »  tt-condition  f(x)  is  satisfied  by  B]. 

.  i  : 

We  show  that  C.  is  computable  from  B  in  C-recursive  time.  The 
!  A 

procedure  we  will  uste  for  computing  CA  using  a  B-oracle  is  as  follows: 
!"Given  input  x,  we  compute  f(x).  f  is  recursive  in  C,  so 


we  simulate  a  machine  computing  f  from  C;  we  use <p 
obtain  answers  to  questions  about  mdmbership  in  C. 


(B) 


to 


Once  we  have  the  trutji-table  f(x),  we  then  ask  the  B-oracle 

i  1  r 

aboiit  membership  of;  each  argument  in  the  truth  table  and  use  the 


i  i 


i 


i 


i 
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answers  to  tind  the  value  of  CA(x)  from  the  truth  table. ■' 
How  much  time  Is  required  by  this  procedure? 


If  we  assume  that  f  -<pJ(C),  then  we  can  obtain  f(x)  in  time 


approximately  bounded  by: 


2T1(C)(x) 

T  (C)(x)  +  L 
J  y«0 


g(y), 


since  the  largest  value  y  for  which  we  might  need  to  compute  <p  &\y) 

T  <W(X)  1 

*8  ^  1  •  Clearly,  this  sum  Is  bounded  by  a  total  C-recursive 

function. 


Once  we  have  f(x),  It  Is  not  difficult  to  show  that  the  remaining 
time  require  to  obtain  CA(x)  by  asking  the  appropriate  questions  about 
membership  In  B  is  bounded  by  a  C-recursive  function. 

Thus,  the  total  time  is  bounded  by  a  C-recursive  function,  so 
A  B. 

QED 

Each  set  determines  a  reduclbility.  We  may  obtain  a  "hierarchy 
of  reduclbllltles"  between  truth-table  and  Turing  reduclbilltles, 
ordered  by  a  comparability  relation.  Using  a  relatlvisation  of  the 
compression  theorem,  we  conclude  that  comparability  Is  exactly 
determined  by  slate  of  functions: 

Theorem  3.11:  Assume  we  are  given  two  sets,  C  and  D.  Then 
f  (VA, B)  fA  B  »  A  Sp  B ]  ]  »  f  (Vf  e  Rirr))(3g  e  R^Vg  S  f  a.e.  ]] 


Proof:  (  *-)  Obvious. 
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(-»)  Aotuiae  (3f  C  R^HVg  C  R^®*)  (g  <  f  l.o.  ). 

Then  by  •  direct  relativiaation  of  the  compression  theorem, 

(3A  recursive  in  C)(Vi)Rp1^)  .  cA  ■*  #t(C)  >  f 

It  ie  easy  to  show  that  A^C  but  iAy),  a  contradiction. 

QED 

Corollary  3.11.1:  For  any  seta  C,  D, 

(C  *<j>  D)  **  (C-reducibility  •  D-reducibility) . 

In  the  remainder  of  this  chapter,  ve  aak  about  the  converts  of 
Corollary  3.11.1.  That  ia,  if  aeta  determine  the  aaae  reductibility, 
need  the>  be  Turing  equivalent?  In  certain  caaea,  the  inmr  ($  yea: 

Definition  3.12:  A  aet  A  la  weakly  aaloreduclble  if  there  exlata 
f  e  rx(a)  guch  that: 

(Vg)  Tg  s  f  «•  a  ia  recuraive  in  g). 

Thia  definition  la  weaker  than,  although  similar  to,  the  definition 
of  "majoreduclble"  used  and  atudled  extensively  by  Jockuach  in  fJ2J. 

Theorem  3.13:  If  aeta  C  and  D  are  weakly  majoreduclble,  then: 
(C-reducibility  «  D-reducibility)  »  (C  ■  D). 

Proof:  If  C-reduclbllity  -  D-reducibility,  then  by  theoiea  3.11  and 
closure  of  RjvD*  under  finite  modification,  we  have: 

(Vf  e  R1(C))(3g  c  Rj(D))fg  a  f). 

By  weak  majoreduciblllty  of  C,  C  is  recursive  in  g  for  the 


appropriate  choice  of  f. 
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Therefore,  C  *T  d. 

Symmetrically,  we  have  DSC. 

T 

QED 

Corollary  3.13.1:  If  sets  C  and  D  are  recursively  enumerable,  then 
(C-reducibility  »  D-reducibility)  «  (c  s=t  D). 

Proof:  It  follows  immediately  from  work  of  Jockusch  in  fJ2]  that  all 
recursively  enumerable  sets  are  majoreducible  (his  definition)  and 
hence  weakly  majoreducible.  The  reason  is  as  follows: 

uppose  C  is  a  recursively  enumerable  set.  If  c  is  finite,  f  ■  o 
satisfies  definition  3.12. 

Otherwise,  let  (c^  be  an  effective  enumeration  of  C  without 
repetitions. 

Define  f(n)  *  P*T(Vy)(y  >  t  *»  Cy  >  n)]. 

It  is  easy  to  show  that  f  e  R 

If  g  ^  f,  we  may  compute  Cc(n)  by  listing  C  for  g(n)  steps  to  see 
if  n  turns  up.  Thus,  C  is  recursive  in  g,  so  is  majoreducible. 

QED 

Note:  Examination  of  the  proofs  above,  combined  with  the  Friedberg- 
Muchnik  theorem  (Rol,  §10.2]  shows  that  there  exist  pairs  of  recursively 
enumerable  sets  C  and  D  determining  Incomparable  reducibilities ;  that 
is*  (3A,B)f(A  £,  B)  A  ~i(A  b)  ] 

and  (SA,B)f(A  Sp  B)  A  — i(A  S,  B)]. 

e  have  thus  shown  that  for  a  large  collection  of  sets,  if  any  pair 
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determines  the  same  reducibility,  the  two  sets  must  be  Turing  equivalent. 
However,  this  is  rot  true  in  get  In  fact: 

Proposition^^lA :  Given  any  set  C,  there  exist  two  sets  A  and  B  such 
that  AjB  and  A-reducibility  ■  B-reducibility  -  C-reducibility. 

We  omit  a  detailed  proof  because  it  is  quite  long  and  not  very 
different  from  other  proofs  in  the  literature.  There  is  a  modified 

version  fMal]  of  Spector's  splitting-tree  construction  of  minimal  sets 

» 

fRol,  .>13.5]  which  produces  a  nonrecursive  set  A  which  is  "small"  rather 
than  minimal:  that  is, 

(Vf  e  Rj^Hlg  e  Rj)  [g  s  f]. 

In  outline,  in  the  proof  of  proposition  3.14  we  simultaneously 
construct  two  "small"  sets,  A  and  B,  by  modified  splitting-tree 
constructions,  with  two  added  chaises: 

(1)  We  encode  C  into  both  sets  at  the  begiimii*  of  the  construction. 

(2)  We  alternate  the  splitting-tree  construction  with  a  straight¬ 
forward  diagonaliaation  making  A  and  B  Turing  incomparable. 


The  resulting  sets  A  and  B  are  such  that: 


(Vf  G  R1(C>)(3g  G  Rj(A>) 

fg  *  f  a.e. ] 

since  C  ^A, 

and 

(Vf  G  Rj^xag  G  R1(C>) 

fg  *  f  a.e. ] 

by  the  construction, 

and  similarly  for  B. 

Thus,  by  theorem  3.11,  A-reducibility  -  B-reducibility  - 
C-reducibility. 


QED 


Open  Question:  Given  any  nonrecursive  set  A,  is  it  always  possible  to 
find  a  set  B  such  that  a|b  but  A-reducibility  ■  B-reducibility? 

QPgfl  Question:  What  are  necessary  and  sufficient  conditions  on  sets 
A  and  B  for  A-reducibility  to  equal  B-reducibility? 

Although  pairs  of  sets  can  have  the  same  reducibility  and  still  be 
Turing-incomparable,  there  do  exist  limits  on  what  Turing-reducibility 
relationships  sets  can  have  and  still  determine  the  same  reducibility. 
For  example: 

Proposition  3.15:  If  C-reducibility  =  D-reducibility,  then  we  cannot 
have  C'  £  D. 

Proof:  Assume  C'  ^  D. 

Let  g(n)  =  max  {<P1(C)(n)|  0  *  i  £  n  A  cp±<:C)  (n)  i} . 


fC 1 1 

g  e  Rj  ,  so  g  e  r 
But  clearly  (Vf  e 


(D) 

1 


fg  >  f  i.o.]. 


So  by  theorem  3.11,  C-r -jducibUity  ^  D-reducibility. 

QED 

Open  Question:  In  fJl],  Jockusch  develops  the  properties  of  various 
types  of  truth-table  reducibilities ,  e.g.  containment  properties  of 
degrees.  Explore  the  answers  to  these  questions  for  C-reducibilities 
for  various  sets  C.  For  example,  does  C-reducibility  have  any 
properties  significantly  different  from  truth-table  reducibility? 


i 


I 


/ 


4.  Helping 
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Intuitively,  we  have  the  idea  that  some  sets  B  help  to  compute 
some  functions  f.  That  is,  when  we  use  B  as  an  oracle,  we  can  reduce 
the  complexity  of  f  below  what  it  could  have  been  without  the  oracle  B. 

In  this  chapter,  we  try  to  formaliae  this  idea.  We  use  the  word 
"helping"  in  informal  discussions  only,  and  give  precise  meanings  to 
several  interpretations.  We  also  give  several  basic  results  about  the 
existence  of  sets  which  help  or  don't  help  the  computation  of  certain 
functions. 

Definition  4.1;  Assume  B  is  a  set,  f  SRj  and  h  is  a  total  function  of 
two  variables. 

"B  h- improves  f  i.o."  means: 

(3i)(Vj)R>1(B)  -  f  A  r<Pj  =  f  *  h(x,§1(B)(x))<  *j(x)  i.o.]]. 
"B  h-improves  f  a.e."  means: 

(3i)(fj)r«pi(B)  =  f  A  tpi  =  f  *  h(x,«1(B)(x))<  ^(x)  a.e.]]. 

We  remark  that  these  definitions  do  not  provide  us  with  notions 
f  helping  that  are  transitive  or  symmetric.  Appropriate  counterexamples 
will  be  found  as  corollaries  near  the  end  of  this  chapter. 

An  alternative  way  of  measuring  the  amount  of  help  given  by  a  set 
B  t0  a  function  f  is  to  ask  which  lower  bounds  on  the  complexity  of  f 
are  maintained  after  introduction  of  the  B-oracle.  To  speak  about 
this  kind  of  "helping"  we  use  the  definitions  of  Comp(?,)f  and  Comp  f, 
etc.,  Introduced  as  definition  2.6. 
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To  place  these  definitions  in  some  perspective,  it  is  helpful  to 
note  »  relationship  between  "A  *p  B"  and  "B  h-lmprove.  A": 

Assume  A  is  not  primitive  recursive.  Then  for  any  primitive 
recursive  function  p  of  one  variable,  we  know  that  Comp  A  >  p  i.o.  tC] 

But  if  A  s  B,  then  for  some  primitive  recursive  function  q  of 
one  variable,  cLpWA  a  ,  ....  Because  the  primitive  recursive 
function,  are  closed  under  composition,  h  o  ,  is  primitive  recursive 
and  therefore  Comp  A  >  h  o  q  i.o. 

But  since  Comp(B,A  a  q  a,..,  we  know  that  B  h-lmproves  A. 

We  note  that  the  amount  of  help  a  recursive  oracle  B  is  able  to 
give  the  computation  of  a  function  is  restricted  by  the  complexity 
„f  B.  This  i.  because  any  program  using  B  a.  an  oracle  may  be  converted 
to  one  not  using  the  B-oracle,  by  directly  computing  the  answers  to 
the  oracle  queries.  The  complexity  of  the  new  program  is  bounded  as 

follows: 


Theorem  4.2:  There  exist  gj,  B2  *  *3  "lth  the 

For  all  B,  1,  j,  if  C„  -  V  then  there  exists  k  such  that: 

(B) 

(Bl  v  $  (y))  •  (x)  • 

Proof:  Although  this  proof  doe.  not  exactly  fit  the  statement  of 
the  combining  Imrnna,  we  note  the  essential  similarity  of  the  proofs; 
we  call  this  type  of  argument  a  ■•domaln-of-convergence"  argument. 
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We  use  the  following  general  lemma 

Lemma  4.2.1:  Fix  any  acceptable  enumeration  of  relative  algorithms  pp  (  >} 
and  any  relative  complexity  measure  \  Then* 

(a8  e  R3)(Vi,x,y)(VA,B) 

f(Afl  f° . g(i,x,y))  =  B  fl  (0,...,g(i,x,y)})  => 

(($i(A)(x)^y  «  $i  ’  (x)  *  y)  A  (#^>00  Sy  » 

(^^(x)  =Pi(B)(x))))]. 

Proof  of  lemma  4.2.1:  Let  (T± ^  be  the  standard  enumeration  of  oracle 
Turing  machines. 


Axiom  (2)  for  relative  complexity  measures  will  allow  us  to  conclude 
the  existence  of  a  relative  algorithm  c/  ^  such  that: 

(Vi,x,y,X)  or(X)(<i,x,y>)  =  ^  *f  $i  (X)  *  V’ 

0  if  not. 


Therefore,  by  lemma  2.2,  there  exists  an  oracle  Turing  machine  Tj ^  ^ 
such  that: 


00, 


Tj'“'(<i,x,y>)  *  ^1  if  «1(X)(X)  *  y, 

0  if  not. 


Now  fix  i,  x  and  y.  Let  f  be  the  recursive  Isomorphism  (lemma 
2.2)  between  the  two  Godel  numberings. 


Define  g(i,x,y)  =  max  g'(i,x,y,X),  where  g'(i,x,y,X)  is  defined 

X  C  N 


as  follows: 
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r 


g'(i,x,y,X)  - 

the  largest  number  whose  membership  in  X  is 
questioned  in  oracle  Turing  machine  compu¬ 
tation  T  ^(<i,x,y>)  if  T/  ^  (<i»x»y>)  =  °* 

l 

the  largest  number  whose  membership  in  X  is 
questioned  in  either  computation 

Tj(X)(<i,x,y>)  or  computation  Tf(1)(X\x)  if  TJ ^ (<i,X,y>)  "  ** 

s. 

Lemma  2.5.1  shows  that  g  S  Rj 

Now  assume  that  A  fl  {0 . g(i>x,y)}  =  B  H  {0 . g(i,x,y)} . 


Then  by  definition  of  g',  we  have  that: 

Tj(A)(<i,x,y>)  -  TjW(<i,x,y>) 

and  (Tj ^A) (<i,x,y>)  =  1)  =»  (Tf(i)(A)(x)  -  Tf(i)(B)(x)) • 

But  by  definition  of  T,  and  f,  this  implies  the  lemma. 

Proof  of  theorem  4.2.  continued:  We  let  g2  -  the  function  g  from  lemma  4.2.1 


The  s-m-n  theorem  allows  us  to  define  a  partial  recursive  function 

cp  .  ..as  follows: 

M*(a,b) 


(A), 


f y  if  (3A)  Cp^{  }(x)  =  y,  and  (Vw  *  g2(a,x,*a  '(x))) 

(w  e  A  «  <pb(w)  =  1)  and 
(w  t  A  «*  cpb(w)  =  0) 
o  otherwise 


By  the  definition  of  g  in  lemma  4.2.1,  the  function  Cp^a^bj  must 
be  well-defined.  It  is  easy  to  see  that  it  is  partial  recursive. 


/ 


Intuitively,  for  or.de  luring  Muhlne. ,  i.  8llnply  th, 

ncticn  computed  by  <pfi  ,  where  we  uee  the  pertiel  recureive  function 
c?b  in  place  of  an  oracle. 


We  now  define  g^.y..,  . .  where: 

a.b^x.ACN 


fa(«,b)^  if  $a(  ^x>  "  y»  and 


g'(x.y,*,a,b,A) 


(*b(w)}  “  *»  a»J 


0SwSg2(a,x,y) 

(Vw  s  s2(*,x,y)) 

(w  e  A  «<pb(w)  -  1)  and 
(w  t  A  «*<pb(w)  =  0), 
otherwise. 


“y  th'  »•  «.  thet  the  li.t.d  condition, 

•re  .efficient  to  imure  the  convergence  of  *a(<  b)(x),  end  .0  hy 
lemma  2.5.1,  gj  e  Ry 


We  now  fix  a  -  j,  b  «  l. 


We  claim  a(j,i)  dSf  k  has  the  required  properties: 


If  x  *  max  (i,j),  then: 

8l(x»#/B)(x)»,nax 

■  _ >•  ^  .  • 


J  •  '  '  /n\  *.  (y))  ^ 

0sy^82(J,x,#  (B)(x))  1 

8  (x,J,  (x) ,max  $  (y)  .  j 

*a(e,b)^x^’  si,lce.  «11  the  listed  conditions 
in  the  definition  of  g'  are  satisfied. 


\ 
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Open  Question:  Can  we  obtain  a  version  of  theorem  4.2  for  oracle  sets 
B  which  are  nonrecursive?  That  is,  can  we  find  any  way  to  bound  the 
amount  of  help  a  nonrecursive  set  B  can  give  to  the  computatioi’  of  a 
function  (for  example,  relative  to  B's  Turing-reducibility  properties, 
or  to  B's  complexity  relative  to  some  set)? 

We  next  show  that  for  any  sufficiently  complex  recursive  set  A, 
there  exist  arbitrarily  complex  recursive  sets  B  that  do  help  the 
computation  of  CA;  in  fact,  which  reduce  it  to  triviality. 

We  may  further  specify  that  the  set  B  be  "compressed"  (i.e. 

B's  complexity  is  very  closely  determined,  to  within  a  fixed  amount 
h  depending  on  the  measure  only) . 

Theorem  4.3:  Let  be  any  relative  complexity  measure.  There  is  a 

function  h  e  R2  with  the  following  property: 

Let  t  be  any  total,  monotone  nondecreasing  running  time. 

Let  A  be  any  recursive  set  *uch  that  Comp  A  s  t  a.e. 

Then  there  exists  a  recursive  set  B  with: 

Comp  B  >  t  a.e. 

Comp  B  s  h  o  t  a.  e. 

and  AS  B. 

P 

(Note:  As  mentioned  in  the  remark  following  lemma  2.7,  this  is  an 
example  of  a  theorem  which  uses  an  honesty  hypothesis.) 

Proof:  The  proof  is  a  domain-of-convergence  argument. 

We  carry  out  the  construction  in  stages,  using  a  Rabin  diagonal 
construction  with  one  modification:  we  introduce  new  programs  into  the 


construction  slowly,  so  most  arguments  are  not  needed  tor  the 
diagonalization.  We  use  the  remaining  arguments  to  encode  A  in  a 
simple  way.  The  idea  is  similar  to  that  used  by  Paterson  in 
theorem  4.6. 

We  define  a  function  f  as  follows: 

f(0)  =  0,  f (ti)  =  LVnJ  -  1  ^  all  n  *  1. 

By  the  s-m-n  theorem,  we  can  define  a  partial  recursive  function 

m  (where  a  e  R„)  according  to  the  following  construction  in 

^a(a,b)  *■ 

s  tages : 

Stage  n:  (Define  <Pa(a>b)  (n)> 

Find  the  smallest  uncancelled  i  ^  f(n)  such  that  $i(n)  £ 

(We  diverge  if  $fe(n)t.) 

If  no  such  i  exists,  define  <iPa(a>b)  (n)  =<Pa(f(n))« 

If  i  exists,  define  ?pa(a>b)(n)  =  1  1  9^)  and  cancel  i. 

Go  on  to  stage  n  +  1. 

END  OF  CONSTRUCTION 

Sow  assume  we  have  A,  t  as  In  the  hypotheses.  If  we  choose  a*, 
b*  with  »b„  -  t  and  <?,*  -  CA  and  it,  then  we  claim  that  <:„  -  9o(a*, 

has  the  desired  properties: 

B  is  clearly  a  recursive  set. 


As  in  the  proof  of  theorem  2.8,  we  can  show  that  Comp  B  >  t 
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To  show  A  £  B,  we  note  the  following: 
P 


2  2 

For  any  n,  consider  all  x  with  (n  +  1)  ^  x  <  (n  +  2)  .  For  all  such 

x,  f(x)  =  n.  There  are  2n  +  3  such  values  of  x.  However,  before  stage 
2 

(n  +  2)  ,  we  only  cancel  indices  £  n.  Thus,  only  n  +  1  of  the  values 
of  x  may  have  Cg(x)  defined  by  a  cancellation.  For  the  remaining 
n  +  2  values  of  x,  we  have  Cg(x)  =  C^(n). 

Then  for  any  n,  (xrf-2)^-l 


CA(n) 


P 

1° 


if  L,  C  (x)  ^  n  +  2, 

x=(n+l) 2  B 

otherwise. 


Therefore,  A  ^  B. 

P 

It  remains  to  show  Comp  B  £  h  o  t  a.e.;  to  do  this,  we  must  first 
define  h: 


i 


Let  h(x,y)  =  max  h'(x,y,a,b),  where: 
a,b£x 


h'(x,y,a,b) 


|Va,b)(x) 


if  (Vw  £x) f$,  (w)  £  y  A  $  (w)  £  y], 

D  fi 

otherwise. 


The  conditions  on  the  right  in  the  definition  of  h'  are  sufficient 
to  insure  that  b^(x)i,  80  that  h'  e  and  thus  h  e  R^. 


Now  if  we  fix  a  =  a*  and  b  =  b*,  we  see  that  for  x  £  max(a*,b*)-, 
h(x, t(x))  ^  h'(x,$b*(x),a*,b*) 


=  $R(a*,b*) a,e*’  aS  re(luired- 


QED 


I 


i 


I 


Remark :  If  we  do  not  require  the  compression  of  set  B,1  a  much  simpler 


construction  suffices: 


Definition  4.4:  For  any  X,  Y,  we  define  X  ©  Y  as  follows: 

(Vx)f(x  ex@Y)  •*  ((x  e  X  A  X  t  Y)  v  (x  e  Y  a  x  t  X))]. 

I  .  1 

Then  if  we  take  sufficiently  large  t'  U,  relative  to  t,  we  can 

i  i  1  i 

obtain  C  recursive  with  Comp  C  >  t'  a,.e. ,  and  let,  B  «=  C  join  (A  ©  C) . 

i  ,  1 

This  set  B  has  two  properties: 

1  ' 

t  '  A  s;  b 

P  I 

and  ;Comp  B  >  t  a.e. 


This  second  property  is  easily  shown  for  space  measure,  using  the 

i 

parallel  computation  property,  and  recursive  relatedness  gives  the  result 
for  general  measures,  i  i 


Results  in  this  chapter  have  so  far  been  rather  intuitive  and 

i 

natural;  less  so  are  results  stating  "independence"  of  S|6ts  (for 
example,  demonstrating  the  existence  of  pairs  of  recursive  sets  which 

i 

do  not  help  each  other's  computation).. 


Solutions  to  problems  of  this  latter  type  turn  out  to  be  analogous 

i 

to  wo-k  on  degrees  of  unsolvability  TSa]  fRol,  $10.2,  Chapter  13]  in  the 

■  i 

following  sense:  i 

■  i  1 


Independence  proofs  proceed  by  a  diagonal! ration  (the  only  general 

» 

tool  we  have  thus  far  for  proving  Such  results).  The  diagonalications 
1  ‘  ! 
require  a  countable  sequende  of  conditions,  or  perhaps  two  different 

I  !  ’  1 

countable  sequences  of  conditions,  to  be  satisfied.  Satisfaction  of 

:  i  i 

» 

these  various  conditions  may  cause  conflict.  To  insure  that  each  condition 


! 


I 
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gets  satisfied,  we  establish  before  the  construction  a  ''priority 
ordering"  of  conditions;  in  our  theorem  ,  this  is  a  simple  numerical 
ordering. 

We  allow  the  satisfaction  of  a  condition  to  be  interrupted  only 
by  switching  to  an  attempt  to  satisfy  a  higher-priority  condition. 

It  follows  that  once  we  begin  trying  to  satisfy  some  condition,  we  must 
thereafter  succeed  in  satisfying  either  that  condition  or  one  o  higher 
priority;  thus,  all  conditions  will  eventually  become  satisfied. 

Our  arguments  use  priority  more  complex  that  the  "initial  segment 
priority  constructions  in  fRol,  Chapter  13];  we  do  construct  our  sets 
by  determining  values  first  on  initial  segments,  but  we  also  carry 
with  us  "tentative  commitments"  to  definition  of  the  set  at  arguments 
a  finite  distance  beyond  the  defined  initial  segment.  It  is  only  a 
finite  distance  beyond,  so  we  are  not  using  the  full  power  of  splitting- 
tree  arguments,  for  example. 

Our  constructions  differ  from  those  in  fSa]  ai  fRol],  h  wever, 
since  we  are  constructing  recursive  sets.  Our  constructions  are  always 
effective,  and  we  insure  definition  of  the  functions  we  construct  at 
all  arguments. 

After  a  degree-of-unsolvability  priority  construction,  arguments  are 
usually  presented  showing  what  oracles  are  used  in  the  construction, 
and  thereby  placing  the  constructed  set  in  its  proper  Turing  degree. 

We  are  working  with  a  subrecursive  analog  of  these  constructions;  we 
are  generally  interested  in  the  complexity  of  the  resulting  set.  Thus, 
we  generally  follow  our  constructions  with  arguments  showing  what 
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subcoeputations  were  used  In  the  confutation  constructing  our  set, 
thereby  placing  the  constructed  set  In  Its  proper  complexity  class. 

Ue  now  aim  to  prove  an  Independence  theorem.  In  order  to  stake 
the  proof  as  compact  as  possible,  ve  first  introduce  definitions 
designed  to  allow  us  to  discuss  the  Independence  of  the  values  of  a 
0-1  valued  function  at  Its  different  arguments.  In  theorem  A. 6,  ve 
give  an  example  of  a  simple  theorem  using  this  definition.  Lesna  A. 7 
shows  the  existence  of  a  0-1  valued  recursive  function  whose  values 
at  Its  different  arguments  are  Independent,  while  theorem  A. 8  shows 
hew  to  split  this  type  of  set  Into  two  sets  which  don’t  help  each  other’s 
computation,  thus  giving  a  complexity-theoretic  analog  to  the  Frledberg- 
Muchnlk  theorem  (Rol,  bl0.2]. 

Definition  A. 5:  Assume  A  is  a  recursive  set  and  g  is  a  total  function 
of  one  variable.  Then: 

"CompfA^A  >  g  a.e."  means: 

(Vl)ff(Vx)(pi(A’^^)(x)  -  CA(x))]  »  (#1(A’txJ)(x)  >  g(x)  a.e.)). 

"Comp  A^A  £  g  a.e."  means: 

(3l)ff(Vx)CP1(A’IxJ)(x)  -  CA(x))]  A  (#1<A_  Xl)(x)  £  g(x)  a.e.)). 

The  following  theorem,  due  to  Paterson  fP),  shows  the  abundance 
of  0-1  valued  functions  whose  values  at  different  arguments  are 
strongly  dependent.  This  settles  a  question  raised  by  Trachtenbrot  fTl). 

Theorem  4.6:  There  exist  r  e  Rj,  h  £  Rj  with  the  following  property: 

Whenever  t  Is  a  monotone  Increasing  running  time,  there  exists  a 
recursive  set  A  such  that: 
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Cotap  A  >  t  a.e. 

Cotap  A  £  h  o  t  a.e. 

And  Cotap  A  £  r  i«c> 

Proof:  We  define  the  set  A,  depending  on  t;  we  indicate  how  to 
construct  r  *nd  h  afterwards. 

We  define  A  by  a  construction  In  atagea.  Aa  we  do  so,  we  cancel 
Indices  1  such  that  we  know<?1  i  C k> 

1, 

Let  f(y)  *  LAJ. 

Stage  x:  (Define  CA(x)) 

See  If  there  exists  uncancelled  1  £  f(x)  such  that  ♦^(x)  £  t(x). 

1.  If  so,  define  CA(x)  -  1  i<?1(x). 

Cancel  1. 

Go  on  to  stage  x  +  1. 

2.  If  no  such  1  exists, 

2.1.  If  |(y|y  <  x  and  y  e  A)  |  is  even,  we  define  CA(x)  -  0. 

Go  on  to  stage  x  +  1. 

2.2.  Otherwise,  define  CA(x)  *  1. 

Go  on  to  stage  x  +  1. 

El®  OF  CONSTRUCTION 

A  Is  clearly  recursive.  We  leave  the  reader  to  verify  that 
substage  1.  Insures  Comp  A  >  t  a.e. 

Verification  of  the  second  claim  depends  on  the  construction  of 
the  proper  h,  which  may  be  done  by  a  dooaln-of-couvergence  argument. 


r 
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To  verify  the  third  claim,  we  use  the  following  procedure  for 
obtaining  C^(x)  from  on  other  arguments: 


}(x) 


For  all  x,  B,  define: 

0  If  there  are  more  arguments  y,  x+1  s  y  s  2x  for  which 
|  ((0,...,y)  -  (x})  0  b  Is  even  than  for  which 
l((0,...,y}  -  (x) )  0  b|  Is  odd, 

1  otherwise. 


That  io,  we  use  the  fact  that  most  arguments  y  with  x  +  1  s  y  s  2x 
were  used  not  to  cancel  Indices,  but  to  maintain  parity. 


From  this  procedure,  It  Is  easy  to  construct  the  function  r  for 
the  time  or  space  measure.  Recursive  relatedness  then  gives  the  result 
for  general  measures. 

QED 

Open  Question:  Is  theorem  4.6  true  without  the  monotonicity  restriction? 


Having  some  familiarity  with  the  way  a  function's  values  at  dlffereit 
arguments  may  Interrelate,  we  now  go  on  to  produce  a  set  A  whose  values 
at  different  arguments  are  Independent.  This  result  In  announced  by 
Trachtenbrot  In  fT2),  He  gives  no  proof,  however;  the  proof  here  Is 
due  to  Meyer. 


.Lemma  4.7:  (Trachtenbrot):  There  exists  g  with  the  following 
property; 

For  any  sufficiently  large  total  running  time  t,  there  exists  a 


recursive  set  A  with: 


Comp  A  £  g  o  t  a.e. , 
Comp  ^  ^  t  a  •  •  • 


Proof:  We  would  like  to  Insure: 


liwwfc  •  - - — 

mKi^'woww  -  <3*)(p1(A'tx)><*>  'caW)1' 

A.  before,  ..  use  cancellation;  we  cancel  an  index  1  when  we’ve 


insured  that: 


(3»)«ii(A‘1x1)W  *  CA<*»- 


In  addition,  at  any  tine  during  tha  construction,  a  single  index 
My  be  "tentatively  cancelled."  If  an  index  i  is  tentatively  cancelled, 
it  means  that  ve  are  in  the  process  of  attempting  to  cancel  1  by 

definite  A  according  to  an  appropriate  "tentative  comnitment."  If  we 

-.a  a  j  ai,i.  we  will  then  cancel  1;  otherwise, 

succeed  In  defining  A  in  this  way,  we  win  men 

the  tentative  cancellation  of  1  »ill  he  removed. 

Me  *ill  use  the  s-m-n  theorem  to  define  a  partial  recursive 
function according  to  a  construction  in  stages.  For  5,  -  t. 

the  function  9a(t)  -1*1  «■  °A  ^  “  “ 

the  parameter  a  to  allow  u.  later  to  obtain  the  desired  recursive 

function  g  by  a  domaln-of-convergence  argument. 

,  n  i  2  where  at  stage  n,  we 

We  will  have  stages  numbered  0,  1,  Z . 

will  define  The  stage,  are  not  executed  in  consecutive 

order,  however.  The  order  in  which  the  stage,  are  executed  is  deter- 

mined  as  follows: 

At  any  time  when  we  are  ready  to  decide  which  stage  is  next  to  be 
executed,  the  next  stage  will  be  st.ge  n  if  and  only  if: 


/ 
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1.  Stage  n  has  not  yet  been  executed, 

2.  *a(n)i, 

3.  For  any  m  for  which  stage  m  is  not  yet  executed, 

$a(n)  S 

an<*  A.  If  $fl(n)  =  $fl(m)  f°r  any  m  for  which  stage  m  is  not  yet 

executed,  then  n  £  m. 

(That  is,  stages  are  executed  in  order  of  size  of  values  of  $  .) 

a 

This  trick  is  similar  to  that  used  in  theorem  2.8. 

We  now  describe  stage  n  of  the  construction: 

Stagey:  (Define  (n) ) 

Find  the  smallest  i  £  n  that  is  not  yet  cancelled  and  such  that: 

(a)  if  some  index  J  is  tentatively  cancelled,  then  i  <  J,  and 

(b)  there  exists  E  such  that: 

(bl)  (VX|  stage  x  has  already  been  executed) Tx  e  E  <p  .  . (x)  *  1], 

(b2)  E  (xjx  £  h(i,n,$  (n))}  ,  where  h  is  the  function  whose  existence 
is  asserted  by  lemma  4.2.1, 

(b3)  n  /t  E, 

and  (b4)  §.  E  (n)  £  $  (n) . 

X  & 

1.  If  such  an  i,  E  exist,  remove  any  previous  tentative  cancellation  and 
tentative  commitment. 

Define  qpa(a)  (n)  -  1  -<Pt(E)(n). 

1.1.  If  (Yx  s  h(i,n,$fl(n))) fstage  x  has  already  been  executed],  then 


cancel  i  and  go  on  to  the  next  stage. 


/ 
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1.2.  Otherwise,  tentatively  cancel  i  and  make  a  "tentative  com¬ 
mitment  to  define  80  that: 

(Vx|x  *  h(i,n,$a(n))  A  x  4  n)  KPa(a) (*)  =  Vx) 1 • 

Go  on  to  the  next  stage. 

2.  If  no  such  i  exists, 

2.1.  If  some  index  J  is  tentatively  cancelled,  consider  E  from  its 
tentative  commitment. 

Define  cp^a^  (n)  *  CE(n). 

2.1.1.  If  for  a,  n  arising  from  j's  tentative  commitment, 
we  have  (Vx  £  h(J ,n,*a(n))) rstage  x  has  already  been 
executed],  then  remove  j's  tentative  commitment.  Change 
J's  tentative  cancellation  to  a  cancellation. 

Go  on  to  the  next  stage. 

2.1.2.  Otherwise,  Just  go  on  to  the  next  stage. 

2.2.  If  no  Index  J  is  tentatively  cancelled,  Just  define <Pa(a) (n)  *  0 
Go  on  to  the  next  stage. 

EM)  OF  CONSTRUCTION 

Now  assume  we  have  t  as  in  the  hypotheses.  If  we  choose  a*  with 
$a+  -  t,  then  we  claim  that  CA  -  <Pa(a*)  haB  the  de8ired  properties: 

A  is  a  recursive  set: 

If  we  assume  that  t  £  \xfx],  then  we  may  easily  show  that  after 
each  stage,  the  next  stage  may  be  chosen  effectively.  Also,  the  search 
for  E  in  substage  (b)  of  each  stage  will  terminate.  With  these  facts, 


the  execution  of  successive  stages  is  an  effective  process. 

Comp  >  t  a.o. « 

We  make  an  important  observation  about  cancellations: 

Fact:  If  an  integer  k  is  tentatively  cancelled  at  some  stage,  then  at 
that  stage  or  later,  some  integer  s  k  will  become  cancelled. 

Proof  of  fact:  1/  induction  on  k. 

Now  for  any  index  i,  suppose  that  (Vx)  f<p±  x)  >  (x)  «  cA(x)]. 

Then  it  is  not  difficult  to  show  that  i  i8  never  cancelled. 

For  if  i  were  cancelled,  it  means  that  at  some  stage  x  we  set  up  a 
tentative  commitment  for  i  which  was  eventually  fulfilled,  so  that 
for  some  x,  E  as  in  substage  (b) ,  we  defined: 

CA(x)  <VE)(x) 

But  by  lemma  4.2.1  and  the  definition  of  E,  we  can  conclude  that: 

^(E)(x)  -v/A-Woo, 

so  that  CA(x)  ^1<A-(«))(X). 

Thus,  i  can  never  be  cancelled. 

There  is  some  stage  in  the  construction  such  that  all  cancellations 
of  indices  smaller  than  i  that  will  ever  occur  have  already  occurred 
by  that  stage.  By  the  fact  above,  it  follows  that  at  subsequent  stages, 
condition  (b)  must  fail  to  be  satisfied  for  index  i.  But  then  lemma 
4.2.1  implies  that  f^Mx))^  >  t(x)  a.e. 

Comp  A  £  *  o  t  a.e. ; 


/ 
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We  see  that  (Va,x)  lfca(x)l  =»  (*)*]« 

i«s,  bv  the  combining  lemma,  an  appropriate  function  g  exists. 

QED 

Remark:  The  following  related  result  has  been  obtained  by  Meyer  using 
similar  methods  (It  has  also  been  announced  by  Trachtenbrot  in  fT2], 
but  without  proof. ) : 

"For  any  g  e  R2,  there  exists  a  recursive  set  A  such  that: 
(Vi)r((Vx)(qp1(A"f^)(x)  =  CA(x)))  ((3j)(<p..  =  CA  A 

g(x,$j(x))  £  $1(A"^x})(x)  a.e.)) ]." 

In  other  words,  the  values  of  CA  at  its  different  arguments  are 

Independent  in  the  sense  that,  for  any  procedure  for  C.  which  uses 

A 

information  about  (?A  on  other  arguments,  there  is  a  faster  procedure 
for  CA  which  does  not  use  any  such  information. 

As  a  result  of  lemma  4.7,  we  now  obtain  the  desired  Independence 
result: 

Theorem  4.8:  There  exists  h  £  R2  with  the  following  property: 

For  any  sufficiently  large  total  running  times  t_  and  t_,  there 

B  C 

exist  recursive  sets  B  and  C  with: 

Comp  B  £  h  o  t  a.  e. , 

B 

Comp  C  £  h  o  t  a.e. , 

v 

(r) 

Compv  'B  >  t_  a.e. , 

B 

and  Comp^C  >  t  a.e. 


Proof: 


We  use  the  following  lemma: 


l£SP*  4>8,1:  Th6re  eXists  k  «  R2  with  ^e  following  property: 
(V$i)(3Sj>  [  Sj  *  a.e.  and  ^  s  k  o  ^  a.e.J. 

(That  is,  for  any  measure  function,  there  exists  a  larger  "space 
function"  which  is  not  much  larger.) 

lemma  4.8.1.  By  recursive  relatedness,  there  exists  a 
function  r  routing  ,<  >  and  ,<  >.  Mithout  lo8„  of  ge„eraUty>  ^ 

may  assume  that  \<5c.v>frfv  V\1  „  , 

,y  inx,y)J  is  a  space  function  and  r  is  monotone 

nondecreasing  in  both  variables. 

Assume  f  is  the  recursive  isomorphism  between  the  Godel  numberings 
of  the  two  measures. 

Then  r  .  Sf{1)  i.  o.oily  ahovn  to  be  a  apace  function,  and  if  « 

l«t  k  -  Xx,ytr(x,r<x,y))],  then  recuraive  relatedne.a  given  the 
required  properties. 

Proof  of  theorem  4.8,  continued:  Lemma  4.8.1  shows  that- if  we  prove 
the  theorem  for  apace  measure  on  oracle  Turing  machine.,  recursive 
relatedness  will  give  the  general  result. 

It  remains  to  prove  the  theorem  for  \ 

Definition  A. 8 ,2:  If  f  and  g  are  any  functions,  we  define  "f  Join  g" 
by:  (Vx)  f  join  g  (2x)  =  f(x) 

f  J°in  8  (2x  +  1)  -  g(x). 

If  tB  and  tc  are  space  functions,  then  t0  join  t(,  may  also  easily 
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be  shown  to  be  a  space  function.  We  may  apply  lemma  4.7  to 
join  t^,  and  obtain  a  recursive  set  A  with: 

Comp  A  S  g  0(tB  join  tc)  a.e., 
and  ComptA,A  >  tB  join  tc  a.e. 

We  write  A  =  B  join  C,  and  claim  that  B  and  C  have  the  required 
properties: 

„  (C) 

Comp'  'B  >  tfi  a.e.: 

Otherwise,  (31) [cp1(C)  -  Cg  and  s  tj  i.o.]. 

But  then  we  can  convert  q>  (  }  to  a  program  which  computes  C 

A 

fast  on  Infinitely  many  arguments,  namely: 

.  cA(x)>  ,„d 

<at>(8j<A*fxh(lt)  s  Joln  t<_  (x))J 
But  this  contradicts  ComptA]A  >  t  join  t_  a.e. 

D  U 

Comp^c  >  tQ  a.e.: 

By  symmetry. 

ComP  B  s  h  o  tB  a.e.,  and  Comp  C  s  h  o  t.  a.e.: 

Define  h(x,y)  -  g(2x,y)  +  g(2x+l,y),  where  g  Is  the  function 
arising  from  lemma  4.7.  We  claim  this  function  h  has  the  required 
properties: 

Comp  A  £  g  o  (tg  join  tc)  a.e.  implies  that: 

(?1)  [c^  -  CA  and  S^go  (tg  join  tc)  a.e.]. 

But  then  may  be  easily  converted  to  a  program  for  C  which 

B 

cn  argument  x,  requires  space  g  o  (t  join  tr)  (2x) 

o  0 
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"  8(2x.tB  join  tc(2x)) 

-  g(2x,tjl(x)) 

h(x,tg(x)),  as  required. 

The  other  case  is  symmetric. 

i 

The  earliest  independence  result  in  the  literature  which  can  be 
stated  in  terms  of  existence  of  two  recursive  sets  not  helping  each 
other  is  due  to  Axt  [A2].  Axt  states  the  existence  of  recursive  sets 
A  and  B  such  that  neither  is  primitive  recursive  in  the  other.  His 

>r00f  d0eS  not  u8e  the  complexity  formulation  of  "primitive  recursive 
in  ,  it  is  an  initial  segment  diagonal  construction  similar  to  theorem 
IV  in  TRol,  Chapter  13].  With  the  complexity  formulation  (theorem  3.2) 
we  may  obtain  Axfs  result  as  a  corollary  to  our  theorem  4.8. 

We  now  use  theorem  4.8  to  obtain  counterexamples  to  transitivity 
and  symmetry  of  helpii*. 

Corollary  4.8.3;  For  .ufflclently  l.rge  function,  k,  the  relation. 

'k-intprovement  a..."  and  "k-improvement  i.o."  are  neither  tr.mitlve 
nor  8yn«netric. 

W®  Wl11  descrlbe  three  sets  which  provide  a  counterexample  to 
all  four  properties. 

We  chooee  running  tinea  tB  and  t,,  »ith  t^  nuch  larger  than  t„. 

Vi 

By  theorem  4.8,  we  may  obtain  B,  C  and  h.  We  then  consider  the 

thr**  8ets  B*  1  -Join  (B  ©  C),  and  c.  We  note  the  following  relation¬ 
ships  between  the  sets: 
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1.  i(B  k- improves  C  i.o.) 

2.  -i(C  k-improves  B  i.o.) 

1 

3.  B  k-iraproves  B  join  (B  ©  C)  a.e. 

i 

4.  B  join  (B  ©  C)  k-improves  B  a.e. 

5.  B  join  (B  ©  C)  k-improves  C  a.e. 

6.  i(C  k-improves  B  join  (B  ©  C)  i.o.) 

i 

1.  and  2.  are  clear  by  theorem  4.8,  if  k  >  h. 

3.  is  true  because  a  B-oracle  reduces  the  complexity  of  B  join  (B  ©  C) 

J 

on  even  arguments  to  triviality  and  on  odd  arguments  to  the  complexijty 

i 

of  C.  Since  is  much  larger  than  tc>  this  is  a  large  reduction  in 
the  complexity  of  B  join  (B  ©  C)  a.e.  To  formalize  this  argument,  we 
can  use  a  proof  for  the  space  measure  and  recursive  relatedness. 

i 

4.  is  trivial. 

5.  is  true  since:  , 

(V„)  rcc(x)  -  CB  J#lB  (B  @  c)(Jx)  e  CB  JolB  (B  ffi  c)(2*  +  1)1. 

I 

6.  If  C  k-improves  B  join  (B  ©  C)  i.o.,  then  either  C  k-improves 
B  join  (B  ©  C)  on  infinitely  many  even  arguments  or  infinitely  many 
odd  arguments.  However,  the  independence  of  B  and  C  obtained  from 

theorem  4.8  shows  that  improvement  cannot  occur  on  infinitely  many 

* 

even  arguments.  Thus,  C  k-improves  B  join  (B  ©  C)  on  infinitely  many 

I 

odd  arguments. 

,  J  5 

It  then  follows  that  C  k'-improves  (B  ©  C)  i.o.,  for  some  k'  which 
is  only  slightly  smaller  than  k.  We  show  that  this  is  impossible: 


I 


I 


/ 
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i  Consider  the  space  measure.  By  definition  of  k' -Improvement, 

(31)  (Vj)  Rp±(C)  “  CB  0  c  and  rqPj  -  CB  0  c  - 

k'Cx.Sj^Cx))  £  S  (x)  l.o.]]. 

f  J 

'  j 

By  the  parallel-computation  property  of  \ 

(3j)  ptpj  *  CB  @  c  1  and  *  h  o  tfi  a.e.  ]. 

i 

Combining  the  two  facts, 

i 

(3l)ftp1C)  “  CB  ©  c  and  k'(x,S1(C)(x))  *ho  tB(x)  l.o.]. 

(C) 

We  can  use  and  a  program  (p^  for  C^,  with  Sj  s  h  o  i-  a.e., 

/p\  (p) 

and  thereby  obtain  a  program  m  v  ’  **  C_  with  k'  o  S  '  ;  sho  t_  l.o. 

xn  B  !  xn  ,  d 

i 

i 

\ 

But  for  k1  sufficiently  large,  this  contradicts  the  hypothesized 
Independence  of  B  and  C. 

i 

For  general,  measures  $  ,  we  obtain  the  same  result  If  we  require 

k  to  be  much  larger  than  the  measure- Invar lance  function  r  obtained 

i  1  (  \  \ 

by  applying  theorem  2.5  or  remark  2.5.2  to  and  S  . 

•  •  i 

1  i 

The  following  diagram  summarizes  our  results: 


Checking  the  diagram,  we  see  that  we  have  a  counterexample  to  all 
four  properties. 

‘  I 

QED 

{  ! 

! 
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5.  Universally-Helped  Sets 

In  this  and  the  next  chapter,  we  a.h  it  it  1.  “  1"*'rove 

on  theorem  4.8.  Specifically,  theorem  4.8  prove,  the  existence  of  two 
independent  recur.iv.  aet.  by  a  diagonaliaation.  Thi.  leave,  op-,  the 
possibility  that  independent  set.  are  pathological,  we  would 
know  if  we  can  obtain  a  stronger  result  which  allow,  u.  to  fix  one  of 

the  two  sets  arbitrarily. 

We  are  thus  led  to  ask  the  following  (informal)  question: 


Which  is  true? 

(1)  There  is  a  recursive  set  A  whose  computation  is  helped  by 
all  sufficiently  complex  recursive  sets  B  (a  "universally-helped  set  >, 

or, 

(2)  For  any  recursive  set  A,  there  exist  arbitrarily  complex 
recuraive  set.  B  that  don't  help  the  computation  of  A. 

uwwerk  8.1:  We  first  note  that  any  recursive  set  will  he  universal  y- 
helped  in  an  appropriate  measure:  Fix  any  k  e  Rj.  »>ootooe  Increa.ing 
in  both  variables.  Let  our  model  for  computation  be  oracle  Turing 
machines.  Define  a  measure  *(  '  •»  follows: 

s  (4)(x)  if  <3y  Sx)ly  e  A], 

i  K  ko  ko  S  <A)(X)  Otherwise. 

Now  consider  a  "strongly  k-compressed"  set  A;  in  other  words, 

assume  that  there  exists  a  total  function  t  with: 

(Vi)Rpi  -  CA  si  >  t  a.e.  I, 


In  the  remainder  of  Chapter  5,  we  work  within  an  arbitrary 
complexity  measure  and  produce  a  recuraive  set  A  whose  computation  is 
helped  by  oracles  for  all  sets  whose  complexity  may  be  compressed 
between  "honest"  bounds  (bound  functions  whose  running  times  are  closely 
related  to  their  sizes.)  We  refer  back  to  the  remark  following  lenma  2.7 
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Further  discussion  of  honesty  may  be  found  In  JMcC)  'HcCMeJ  end  !Ke.Mo). 

We  note  that  theorem  4,1  he*  already  given  ua  that  every  recuraive 
set  A  la  helped  by  arbitrarily  complex  recuraive  aeta  B.  Theae  sets  1, 
however,  were  constructed  In  a  very  apeclal  way,  to  encode  A,  In  the 
next  result,  the  aeta  B  arc  not  eneodlnga  of  A,  but  may  be  describe.! 
by  a  reatrlctlon  (more-or-leas)  independent  of  A. 

The  function  g  in  theorem  5.2,  aa  well  aa  In  the  thec.ems  In 
Chapter  6,  will  depend  only  on  the  relative  complexity  measure  C  we 

are  considering,  and  will  repreaent  a  fixed  amount  of  extra  reaource 
needed  to  carry  out  certain  simulations.  For  measures  like  apace, 
we  may  often  think  of  g  aa  any  function  which  najorltea  (la  greater 
than)  linear  functions;  for  other  measures,  we  may  still  regard  It  as 
snail  relative  to  the  other  functions  we  are  considering. 


First,  we  require  a  definition: 


Definition  5,2.1:  For  any  h  €  R2  define  a  recursive  set  Ah 
Write  x  ■  <x1,x2»*3:>- 


C.  (x)  - 
*h 


fl  -  <1  -  <PXi(x2))  if  *Xi<x2)  *  l‘(»2*x3)* 


otherwise. 


(The  use  of  the  "4"  la  only  to  keep  0-1  valued.) 


as  follows: 


Theorem  5.2:  (universally-helped  set) 

There  exists  g  e  R2  with  the  following  property: 

For  all  k,  h  e  r2,  k(x,y)  a  y,  and  all  total  running  tinea  t, 

any  set  B  with: 

Coop  B>go  ko  go  t  l.o. 
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and  Comp  B  s  h  o  t  a.e. 

k- improves  i.o. 

Proof:  We  give  three  lesxaas  defining  functions  g^,  g 2  «nd  g^  vhich 
represent  extra  resource  required  to  combine  certain  processes  in  the 
proof.  The  g  in  the  stateaent  of  the  theorem  will  be  a  combination  of 
gj(  g£  end  gy  We  use  domaln-of-convergence  arguments. 

teams  3.2.2:  There  exists  gj  c  R,  such  that  whenever  is  total, 
there  exists  qjj  •  with: 

g1(*.Oj(x))  a  *j(x)  a.e. 

(Note:  This  says  that  running  times  are  honest.  See  the  remark 
following  lemma  2.7.) 


Proof  of  lemma  5.2.2:  B/  the  axioms  for  relative  complexity  measures 
and  the  relativised  s-ta-n  theorem,  it  is  easy  to  see  that  there  exists 
a  recursive  function  or  such  that: 

(Vi.B.xH^^^x)  -Pa(1)(B)(*)l- 

We  define  g.(x,y)  -  max  g'(x,y,a),  where: 

a«x 


g'(x,y,») 


if  y  -  ♦,(*). 

otherwise. 


The  second  lemma  gives  an  upper  bound  on  the  amount  of  resource 

needed,  with  a  B-oracle,  to  compute  C.  : 

*h 

Lemma  5.2.3;  There  exists  g2  C  R2  with  the  following  property: 

For  any  h  G  R^,  any  set  B  and  any  total  running  time  t  for  which: 
(3i)f(ip1  -  CB)  A  <*t  £  h  o  t  a.e.)), 


It  oust  be  true  that: 
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(ajMCPj <B’  «  C^)  A  (#J(B)(<i,x,t(x)>)  *  g2  o  t(x)  a.e.)]. 

Proof  of  learoa  5.2,3:  We  let  {F^}  be  •  canonical  enumeration  of  all 
functions  defined  on  a  finite  domain.  That  la,  ve  assume  that 
Xl.xfFjCx)]  la  partial  recursive  and  X.I , x fCdoaaiT^  p  (x)  J  la  total 
recursive. 


Using  the  relativised  a-m-n  theorem,  ve  define: 


9  (X)(x)  - 

“(a,b,c,d)  W 


F#(x)  If  x  e  domain  F#, 

Cx(x2)  If  x  t-  domain  F#  and  Xj 

^d^x2^  "  x3* 

<p  (x)  otherwise, 
c 


»  b  and 


Nov  define  g2(x,y)  •  max  g' (x,y,a,b,c,d) ,  vhere: 

a,b,c,d£x 

go(*.y,«,b,c,d)  -  max  g”(x,y,a,b,c,d,X) ,  and: 

XQJ 


g^O'.y.o.c.rf.x) 


#a(a,b,c,d)  <<b-*«,Vx)>)  lf  Vx)  £*i<x»y>’ 


otherwise. 


Lenaa  2.5.1  la  used  to  shov  that  g2  Is  recursive. 


We  now  fix  a,b,c,d,X  as  follovs: 


Let  F  be  a  finite  function  giving  values  of  C.  on  nil 
*  % 
arguments  of  the  fora  <i,x,t(x)>  for  vhlch  f^(x)  >  h  o  t(x). 


Let  b  ■  1,  the  given  Index  for  C&. 


Let  c  -  an  Index  for  a  program  for  C 
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Let  d  be  an  index  for  t  with  the  property  that  *j(x) 
s.  g^(x,t(x))  a.e.  (by  lemma  5.2.2). 


Let  X  -  B. 


It  is  now  easy  to  verify  that <Pa(a>b>c >d) 

Also,  if  x  5s  oax(a,b,c,d) ,  then: 

g2(x,t(x))  a  g'^(x,t(x),a,b,c,d,B) 

(B) 


(X) 


-cv 


*  *or(a,b,c,d)  <<b.*.<Vx)>)  a.e.,  as  required 


The  third  lose  provides  us  with  an  upper  bound  for  the  amount 

of  resource  needed  to  convert  a  program  for  C.  into  a  program  for  C_: 

\  b 

5. 2.4:  There  exists  g^  e  R2  having  the  following  property: 


Fcr  an y  h  c  R2>  any  set  B,  any  total  running  time  t,  and  any  1,  J,  1 
for  which: 

fe?i  -  CB)  A  (*l  S  h  o  t  a.e.)), 

and 

it  must  be  true  that: 


°J  •  V 


(31)  -  Cg)  A  (*l(x)  £  g3(x,oax(g1(x,t(x)),*j(<i,x,t(x)>)))  a.e.)], 


proof  of  lcmna  5.2.4:  We  use  the  s-m-n  theorem  to  define: 


jF.(x) 

pQr(a,b,c,d)  *  |pc(<b,x,pd(x)>) 


if  x  C  domain  F  , 
otherwise. 


Now  define  g3(x,y)  -  max  g ' (x,y,a,b,c,d) ,  where 

a,b,c,d£x 


g'(x,y,a,b,c,d) 


*o(«,b,c,d)<x)  l£  *d(x)  *  v twl  *c<<b»x^d<x>>>  s  y» 


0 


otherwise. 
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Clearly,  g3  e 

**ow  fix  a,  b,  c  and  d  as  follows: 

Let  F#  be  a  finite  function  giving  values  of  CD  on  all 

B 

arguments  x  such  that  ^(x)  >  h  o  t(x). 

Let  b  ■  i. 

Let  c  »  J, 

Let  d  -  an  index  for  t  with  the  property  that  »dSgo  t  a.e. 

(by  leszaa  5.2.2). 

It  is  easy  to  see  that  cp  .  .  -  C  . 

vOf(a,b,c,d)  B 

Now  if  x  S  oax(a,b,c,d),  then: 

gjfx.raaxfgjfx.tfxlJ.^^i.x.tCx)^))  a 

g,(x,max(g1(x,t(x)),*j(<i,x,t(x)>)),a,b,c,d) 

*  #cr(a,b,c,d)<x)  ••«•(*)»  «•  required 

.Proof  of  theorem  5.2,  continued: 

We  now  define  g  •  oax(g1,g2,g3). 

L«t  Pt  -  CB  with  IjSho  t  a.e. 

Then  by  lecraa  5.2.3, 

(3J)ffc>j(B)  "  C^)  A  (*j(B)(<i,x,t(x)>)  Sgo  t(x)  a.e.)). 

But  lemma  5.2.4  Implies: 

(^J)f(Pj  “  C  )  *  j  (<i»x,  t(x)>)  >ko  go  t  (x)  i.o.)), 

since  otherwise,  we  obtain  a  contradiction  to  the  lower  bound  on  B's 

1 


I 
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complexity. 

But  this  clearly  «how>  that  B  k-lmprovea  i.o. 


QED 


We  have  thua  deacribed  an  intereating  altuatlon:  we  have  aeta 
which  are  helped  by  all  aeta  vhoae  complexltlea  are  coopreaaed  between 
honeat  bounda.  and  the  extent  to  which  they  help  dependa  on  how 
tightly  coopreaaed  their  complexltlea  are. 

Never theleaa,  there  are  many  aeta  whoae  complexltlea  are  not  ao 
corapreated;  aeta  with  apeed-up  are  one  example. 

Open  Queatlop;  Are  there  recurelve  aeta  which  are  h-coopresaed,  but 
not  between  honeat  bounda?  Specifically,  la  It  true  that: 

For  all  g,  h  e  R2,  there  exlat  aeta  A  and  functlona  t  CRj  auch 
that  Comp  A  >  t  a.e.  and  Comp  A  fi  g  o  t  a.e.,  but  auch  that  for  no 
total  running  time  f  la  It  true  that  fComp  A  >  t*  a.e.  and 
Comp  Ai  hot1  a.e.  ]? 

We  can  aak  elollar  queetlona  for  Coop  A  >  t  l.o.  and  Coop  A  >  t'  l.o. 


6.  Sets  That  Don't  Help 


88 


/ 


In  this  chapter,  we  present  two  theorems  which  have  the  opposite 
Intuitive  interpretation  to  the  main  result  of  Chapter  5.  Both 
theorems  begin  with  a  recursive  set  A  and  a  lower  bound  on  the  com- 
plexity  of  A,  and  conclude  the  existence  of  arbitrarily  complex  sets 
B  that  ••preserve”  the  lower  bound  on  A's  complexity. 

In  both  theorems  in  this  chapter,  a  function  g  is  used,  representing 
a  minimal  amount  of  helping  which  the  set  B  is  allowed  to  give  to  A's 
computation.  Hie  functions  g  are  necessarv  because  of  the  existence  of 
pathological  measures  such  as  those  given  in  remark  5.1.  As  before, 
each  function  g  will  depend  on  the  measure  only  end  may  therefore  be 

co  sidered  to  be  very  small  compared  to  the  other  functions  we  are 
conslderii^. 

We  begin  with  a  definition: 

—  — 10,1  6~-1;  He  “y  th*c  •  Property  hold,  "tor  .rbltr.rlly  coople, 
recursive  sets"  if: 

<Vr  *  R1,<3B  '««,!„)  tCo.p  B  >  r  «.e.  and  B  h..  the  de.lred  property). 

Io  th-  flr.t  theorem,  ve  consider  ep  i.o.  lover  bound.  Intuitively, 
theorem  6.2  makes  the  following  statement: 

For  any  recursive  set  A  whose  complexity  exceeds  a  known  lower 
bound  i.o.,  there  exist  arbitrarily  complex  sets  B  such  that  the 
complexity  of  A  with  a  B-oracle  still  exceeds  the  lower  bound  i.o." 

“he  method  of  proof  is  similar  to  that  used  by  Machtey  fMa2,  theorem 


/ 
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4.9]  In  hi*  proof  of  the  result: 

"If  f  *nd  g  ere  recuraive  function*  with  f  not  primitive  recursive 
then  there  exists  e  recursive  set  C  such  that  f  i,  not  primitive 
recursive  in  C." 

We  remark  that  for  the  sets  B  of  our  construction,  it  is  still 
possible  that  B  may  greatly  help  A  i.o. 

Theorem  6.2:  There  exists  g  e  r2  with  the  followit*  property: 

For  any  tA  e  Rj,  and  any  recursive  set  A  with: 

Comp  A  >  g  o  t  i.o., 

there  exist  arbitrarily  complex  recursive  sets  B  with: 

Coap(B)A  >  tA  i.o. 

Proof:  We  obtain  g  from  the  following  lecma: 

Lemma  6.2.1;  There  exists  g  c  R2  with  the  followii*  property: 

Whenever  A  i,  .  finite  set,  r  €  Rj,  ««d  .  r 

there  exists  J  such  that: 

"  r  (on  *11  arguments) , 

and  £  g  o  a>(< 

fropf  of  lenrna  6.2.1;  Follows  from  the  combinii*  learn*. 

Without  loss  of  generality,  we  may  assume  that  g  is  monotone 
increasing  in  both  variables. 

hroof  of  theorem  6.2.  continued: 

We  choose  tfi  e  Rj  arbitrarily.  tfl  will  be  a  lower  bound  on  B's 
complexity. 
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Uil‘  8  V  —  V”  ***  *«-  at  .tag,  ,. 

During  the  conatruetion,  ve  ciIKc,  ljrflcct  of  prograBj  ^  ^  ^ 

from  CB.  m  the  course  of  the  construction,  integers  «,  b  and 
<=  -m  Do  defined  end  ch.nged  from  et.ge  to  etege,  .here: 

*  Deep,  count  of  ho.  many  eondition.  #£  .  type  ^  ^ 

so  far  succeeded  in  satisfying, 

b  *'  nl<*,)  IndlC*Ce*  vhlch  program  ,rc  currc„t!y 

examining,  and 

C  keep,  tr.ek  of  .  tentative  eommitment  to  .n  extension  of  the 
already-defined  initial  segment  of  B. 


We  let  -  {y  s  x|y  eg) 


We  start  with  •  -  b  -  0,  c  undefined.  (That  is,  „e  have  not 
yet  ..tl.fled  any  of  the  condition.  ve  .„„,d  Uke  to  ..ti.fy,  ., 

examining  .,  have  „  tentative  fitment  to  an  extenaion 

Of  the  already-defined  initial  segment  of  B.) 


Stage  x: 

See  if  there  exists  i  <  a  such  thmt-  < 

«  such  that  i  is  not  yet  cancelled  and 

Vx)  S  Vx)* 

l*  If  80»  consider  the  smallest  such  i. 

Let  CB(x)  -  1  -pt(x),  and  cancel  i. 

Let  c  become  undefined. 

Go  on  to  stage  x  +  1. 


2.  f  no  such  i  exists,  define  C„(x)  «  0. 

B 


91 

See  If  c  Is  defined. 

2.1.  If  80,  see  if  c  -  x. 

2.1.1.  If  c  -  x,  redefine  a  «  a  +  1, 

b  -  n1(a), 
c  »  undefined, 
and  go  on  Co  stage  x  +  1. 

2.1.2.  If  c  +  x,  just  go  on  to  stage  x  +  1. 

2.2.  If  c  is  not  defined,  see  if  there  exists  an  argusient  y  such  that 

a  £  y  £  x  and  either  t^^x^  (y)  >  t^(y), 

or  (#b(V(y)  «  tA(y)  and  Qb(V(y) 

2.2.1.  If  so,  let  h  be  the  function  whose  existence  is  asserted 
in  lemma  4.2.1  and  consider  h(b,y, tA(y)) . 

2. 2. 1.1.  If  h(b,y,tA(y))  is  *  x,  then  redefine: 

a  *  a  +  1, 
b  -  Ti1(a), 
c  ■  undefined. 

Go  on  to  stage  x  +  1. 

2. 2. 1.2.  If  h(b,y,tA(y))  >  x,  then  define  c  -  h(b,y, tA(y)) . 
Go  on  to  stage  x  +  1. 

2.2.2.  If  no  such  argument  y  exists,  Just  retain  the  values  of 
a  and  b  and  go  on  to  stage  x  +  1. 

EM)  OF  CONSTRUCTION 


92 


i 


Verification  of  the  construction: 

The  key  claim  la  that  the  variable  a  In  the  construction  oust 
Increase  without  bound.  Suppose  It  does  not. 

This  would  mean  that  eventually  a  would  reach  a  stable  value,  say 
aQ.  Thereafter,  neither  2.1.1  nor  2.2.1.1  will  be  executed. 

Eventually,  we  will  reach  a  stage  high  enough  so  that  1.  can  no 
loiter  be  executed  (since  there  are  only  finitely  many  1  <  a) .  There¬ 
after,  2.  must  always  be  executed. 

I 

Subsequently,  if  c  Is  ever  defined,  then  there  is  no  way  for  c  to 
become  undefined.  Thus,  we  would  be  forced  to  execute  2.1  at  every 
stage  until  we  are  compelled  to  execute  2.1.1,  a  contradiction.  Thus, 
c  Is  subsequently  never  defined. 

But  this  Implies  that  2.2.  must  be  executed  at  every  stage  from 
some  point  on.  However,  2.2. 1.1.  cannot  be  executed,  and  2.2. 1.2.  cannot 
be  executed  since  c  cannot  become  defined.  Therefore,  from  some  stage  on, 
no  argument  y  satisfying  the  conditions  In  2.2.  will  e\er  be  found. 

tut  this  means  that  for  b^  ■  TTj(a0): 

(3x)(Vy  *  e  )f(p.  (V(y)  -  CA<y))  A  <*  (V  (y)  *  tA(y))]. 

u  Dq  0 

But  then  lemma  6.2.1  gives  a  program such  that: 

'CA  *"*  *i  S8°  V*’'” 

contradicting  the  hypotheses  of  the  theorem. 


Thus,  we  see 


that  a  must  Increase  without  bound. 


t 


I 


Comp  B  >  (L  : 

‘  I 

ror  any  index  it  if  s  i.o.,  Chen  clause  1.  will  eventually 

become  executed  for  1,  Insuring  that  4).  i  C  . 

1  B 

Comp^A  >  t.i  i.o. : 

Assume  the  contrary:  (3l)f(pi(B)  -  cA)  A  <#  B)  £  tA  a.e.)]. 

Then  there  exists  some  least  integer  aQ  such  that  rj(*0)  *  i  and 

(Vy  *  a0H*l(B)(y)  £  tA(y)].  When  a  is  first  set  equal  to  a^  at  some 
stage,  c  is  undefined,  by  2.1.1.  or  2. 2. 1.1. 

•  » 

Since  a  grows  without  bound,  it  follows  that  eventually  2.2.1.  must 

I 

get  executed  at  some  stage  x  when  a  ■  aQ. 

* 

But  this  implies  that: 

(3y,a0  Sys  x)f(f1(Bx)(y)  >  tA(y))  V 

f(#l(Bx)(y)  *  tA(y))  A  (P1(Bx)(y)  ^  CA(y)) J. 

Moreover,  eventually  thereafter,  either  2.2, 1.1,  or  2.1.1.  must  get 
executed,  unless  prior  to  their  execution,  clause  1.  is  executed.  But 
if  this  happens,  then  c  again  becomes  undefined  so  2.2.1.  must  again 

executed.  1,  can  only  Intervene  finitely  many  times,  since  there  are 
only  finitely  many  indices  less  than  a^.  Thus,  we  can  assume  without  loss 

of  generality  that  1.  does  not  intervene. 

1 

But  in  this  case,  we  insure  that: 

(^y  *  •0)f(*i(B)(y)  >  tA(y>)  v  f(*l(B)(y)  *  tA(y ))  A  (p^Cy)  i  CA(y))]], 
by  lemma  4.2.1.,  which  is  a  contradiction. 

1  , 

QED 


! 


94 


Renark  6.2.2:  We  note  that,  for  the  apace  measure  S  ,  the  function 
\x,yfy]  will  suffice  to  satisfy  lensta  6.2.1  and  hence  theorem  6.2, 
provided  that  tA  la  nontrivial  (l.e.  t  2  Xxfxj).  The  method  for 
showing  this  Is  not  the  method  of  the  given  proof  of  the  lemma,  but 
rather  a  direct  proof  by  analysis  of  oracle  Turing  machine  space 
measure;  Information  about  A  and  about  the  flnltely-many  exceptions  to 
■  r"  may  be  stored  In  the  Turing  machine's  finite  control. 

In  fact.  If  we  are  Interested  only  In  the  space  measure,  It  Is  not 
only  possible  to  sharpen  our  result,  but  to  simplify  Its  proof  as  well. 

This  Is  because  of  the  following  fact  about  \  not  true  for  general 
measures: 

Fact  6.2.3:  (VA,  1,  Vt  e  with  t  2  Xxfx)) 

If  *  t  a.e.  and  <p^A^  is  total,  then: 

(3J)K<Pj^  -  A  (  Sj(A)  £  t  everywhere)). 

Fact  6.2.3  Implies  that  for  S(  ",  we  need  only  Insure: 

(Vl)(3y)f<p1(B)  -  CA  -  S1(B)(y)  >  tA(y)], 

rather  than: 

(Vl)(Iy)fc/B)  -  CA  «*  S1(B)(y)  >  tA(y) ). 

This  eliminates  the  need  to  consider  each  B-oracle  program  Infinitely 
often  during  the  construction;  we  need  only  consider  It  once.  Thus,  the 
need  for  variable  b  Is  eliminated. 

Theorem  6.2  provides  the  following  corollary  about  primitive  recursive 


reduclblllty: 
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Corollary  6.2.4;  If  A  is  any  recursive  sec  which  is  not  primitive 

recursive,  then  there  exist  (in  any  measure)  arbitrarily  complex  sets  B 

such  that  k  i  B  and  B  i  A. 

P  P 

(Recall  that  £  means  "primitive  recursive  in  ") 

Proof:  We  show  the  result  for  the  space  measure;  clearly,  recursive 
rclatcdness  gives  the  general -measure  result. 

Since  (Vh) fh  is  primitive  recursive  *»  h  0),  the  proof  of 
corollary  3.5.2,  with  each  Bt  ■  0,  shows  how  to  obtain  a  recursive 
function  f  such  that: 

(Vh) fh  is  primitive  recursive  a  Comp  h  £  f  a.e. ). 

Thus,  Comp  A  >  f  i.o. 

By  theorem  6.2  for  tA  -  f  and  space  measure  (where  g  *  \x,yfy], 
as  in  remark  6.2.2),  we  obtain  arbitrarily  complex  sets  B  such  that 
Comp^A  >  f  i.o. 

We  claim  that  f  is  greater  than  or  equal  to  each  primitive  recursive 

function  of  one  variable,  a.e.  For  if  not,  then: 

(Sh,  a  primitive  recursive  function  of  one  variable) fh  >  f  i.o.]. 

The  time  and  space  measures  on  oracle  Turing  machines  may  be  shown  to 

be  recursively  related  (in  the  sense  of  theorem  2.5)  by  a  primitive 

fob 

recursive  function  r.  Then  the  function  2  is  clearly  primitive 

recursive.  However,  it  requires  time  2  r  o  h  to  compute  the  function 
on  all  arguments,  since  it  requires  that  much  time  Just  to  output  the 
answer.  Therefore,  it  requires  space  2  h  to  compute  this  function  on 


almost  all  arguments,  by  recursive  relatedness.  Therefore, 
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Comp  2r  0  h>f  ,  _ 

r  i.o.,  a  contradiction  Thne  *  j.  , 

Thus,  f  must  be  greater  than 

or  equal  to  each  primitive  recursive  function  of 

runction  of  one  variable  a.e. 

But  then  Corap  ^  >A  >  f  i.„.  implies  that  A  caimot  be 

bt  ;y  B  “UfflCle"tly  •  —  4.2  shows  th.t  we  eon 

obtain  Corap^B  >  f  i.o.  Thus,  by  theorem  3.2,  B  ^  A. 


that  2  “T  llke  10  COmPSre  tWe"  5'2  “ith  — ~  -  demonstrate 

P-uees  sets  A,  which  are  helped  infinitely  often  by  all  sets  B  whose 
complexities  are  "compressed.,  around  runnii*  times.  Theorem  6.2  does 
not  Produce  sets  B  with  sueh  a  restriction  on  their  oeraplexities.  Per 
proper  eoraparison,  we  would  therefore  lihe  a  strode,  Wressed.. 

version  of  theorem  6.2. 

-  may  obtain  sueh  a  strengthened  version  of  the  theorem  if  „e  are 

'  "  all0W  addItiOMl  oPPoo’Pblons :  rmmely,  ,c  assume  that 

fcB  is  a  running  time,  and  that  t 

B  mo no tone  and  much  larger  than  the 
complexity  of  tA  and  the  complexity  of  A. 

fe^ffitio*:  A  (tB.fj)  A  (Ca=v 

A  (VX),tB(!l)  S  max<tB<x-l),*i(x),#k(x))j] 


The  new  statement  of  the  theorem  is  as  follows: 


Proposition  9 


There  exists  g  e  with  the  following  property: 
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Whenever  we  have  tA,  tB  e  Rp  A  a  recursive  set,  Comp  A  >  g  °  tA  i.o., 
and  the  New  Assumptions  satisfied,  then  there  exists  a  recursive  set  B 
such  that: 

Comp  B  >  tj  a.i., 

Comp  B  ^  go  tB  a.e. , 

/TJ  \ 

and  Comp  A  >  t^  i.o. 

Proof:  Uses  the  construction  in  theorem  6.2,  and  a  domain-of -convergence 
argument  to  estimate  the  complexity  of  B.  We  omit  the  details. 


We  require  one  further  lemma  before  making  our  comparison: 

Lemma  6.2.6:  In  any  measure  \  there  exist  arbitrarily  large 
monotone  increasing  running  times. 


Proof:  Let  us  fix  any  t  £ 


We  use  the  recursion  theorem  fRol]  to  define: 

r 


<¥>t(x)  =  ^ 


0  if  x  =  0, 

or  if  [(cpi(x  -  1)*)  a«d  (^W  >  max(t(x) ^(x  -  1)))] 


00  otherwise. 


It  is  easy  to  show  that  cp^  must  be  total  and  has  the  required 
properties. 


We  now  note  the  following: 

Let  us  use  the  function  g  found  in  proposition  6.2.5. 

Define  g2  e  R2  as  Xx,y fg(x,g(x,y)) ].  Then  we  may  obtain,  by  theorem 

5.2,  a  set  A  ,  which  is  i.o.  g2-improved  by  all  recursive  sets  B  whose 
8 
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complexity  is  weakly  g-compressed  around  a  running  time.  (That  is, 
there  exists  a  total  running  time  tg  such  that  Comp  B  >  tfi  i.o.  and 
Comp  B  ^  g  o  tg  a.e.) 

Now  we  claim  that  there  exists  a  recursive  function  tA  which  is 
a  "good"  i.o.  lower  bound  for  A  ,'s  complexity,  in  the  sense  that  CA  ^ 
can  be  computed  a.e.  in  measure  not  much  greater  than  (This  is 

true  provided  g'  is  honest,  an  assumption  we  may  make  without  loss  of 
generality.  An  examination  of  the  proof  of  theorem  5.2  shows  that: 

\<i,x,y>[g'(x,y)] 

approximates  an  i.o.  lower  bound  for  the  complexity  of  Agl,  and  that 

C  can  actually  be  computed  a.e.  in  measure  not  much  greater  than 

A  i 

8 

this  function. ) 

Using  lemma  6.2.6.  to  obtain  the  appropriate  function  t B>  we 
may  apply  proposition  6.2.5  to  the  function  tA  and  obtain  a  set  B. 

What  is  B's  relationship  to  A  ,? 

O 

B  must  g2-improve  A  ,  i.o.,  by  theorem  5.2.  On  the  other  hand, 

s 

since  B  preserves  the  i.o.  lower  bound  tA  (at  least  to  within  amount  g) , 

it  is  impossible  that  B  g2-improve  Agf  a.e.  Intuitively,  B  g  -improves 

A  .  i.o.  and  B  fails  to  g2-improve  A  ,  i.o.  There  is,  of  course,  no 

g  s 

conflict  here. 

We  note  that  theorem  6.2  has  a  real  relationship  to  "improvement" 

only  in  the  case  where  tA  is  actually  a  "good"  lower  bound  for  A's 

complexity  (i.e.  CA  can  be  computed  a.e.  in  measure  not  much  more  than 

t  )  In  the  case  of  sets  A  having  such  "good"  lower  bounds,  theorem 
h' 
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6.2  allows  us  to  conclude  (tor  sufficiently  large  k)  the  existence 
of  sets  B  for  which  it  is  false  that  B  k-improves  A  a.e. 

However,  not  all  recursive  sets  have  such  "good"  i.o.  lower 
bounds.  For  example,  sets  whose  characteristic  functions  have  sufficient 
speed-up  cannot  have  good  i.o.  lower  bounds.  For  this  type  of  set, 
theorem  6.2  gives  us  no  information  about  improvement. 

Open  Question:  Can  we  obtain  a  more  symmetrical  version  of  theorem  6.2, 
in  which  A  also  preserves  a  lower  bound  on  B's  complexity? 

This  question  may  be  precisely  formulated  in  several  different 
ways.  One  example  is  as  follows:-  Is  it  true  that: 

There  exists  g  e  R2  with  the  following  property: 

Whenever  we  have  tA>  tfi  eR^  A  a  recursive  set.  Comp  A  >  g  o  tA  i.o 
and  the  New  Assumptions  satisfied,  then  there  exists  a  recursive  set  B 
such  that: 

Comp^B  >  t^  i.o., 

Comp  B  s  g  o  t^  a.e.; 
and  Comp  A  >  !•()• 

Open  Question:  For  any  recursive  set  A,  we  have  managed  to  find  sets  B 
which  preserve  any  single  i.o.  lower  bound  tA  on  A's  complexity.  Can  we 
find,  for  each  A,  a  single  set  B  which  preserves  all  i.o.  lower  bounds 
which  happen  to  be  total  running  times)?  Further  discussion  of  this 
question  will  appear  in  Chapter  7. 

The  next  theorem,  theorem  6.3,  is  similar  to  theorem  6.2,  but  the 
kind  of  lower  bound  we  are  considering  is  an  a.e.  lower  bound  instead 


/ 
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of  an  i.o.  lower  bound.  Theorem  6.3  is  almost  a  companion  theorem  to 
theorem  6.2;  it  does  require  the  additional  assumptions  that  t^  is  a 
running  time,  and  that  t^  is  sufficiently  large,  however. 

A  note  on  the  type  of  priority  construction  used  for  this  theorem: 
the  proof  is  a  finite-injury  priority  argument  with  no  apparent  recursive 
bound  on  the  number  of  injuries  of  each  condition. 

Theorem  6,3:  There  exists  g  £  with  the  following  property: 

For  any  total  running  time  t^  such  that  t^  s  \xTxl,  and  any  recursive 
set  A  with: 

Comp  A  >  g  o  t^  a.  e. , 

there  exist  arbitrarily  complex  recursive  sets  B  with: 

(B) . 

Comp  A  >  t^  a.e. 

We  choose  a  function  t_  to  be  an  a.e.  lower  bound  on  B's  complexity. 

B 

Without  loss  of  generality  (as  we  see  from  lemma  6.2.6  above)  we  may 

assume  that  t  is  a  monotone  Increasing  running  time. 

B 


We  describe  a  construction  which  will  give  us  the  required  set  B, 

working  from  t.,  tD  and  A.  We  use  the  s-m-n  theorem.  The  parameters 
A  B 

a,  b  and  c  in  the  construction  are  to  be  thought  of  as  follows: 


$  will  be  t., 
a  A’ 

will  be  t  , 
D  B 

cp  will  be  C  .  . 

C  A 


Definition  of  <+)„,  ,  N  (which  will  turn  out  to  be  C,,  for  a,  b,  c  as  above) 

p(a.D.c)  _ d _ 


Cpp(a,b,c) 


p(a,b,c) 


will  be  defined  in  stages,  with  cp 


(n)  being 
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defined  at  stage  n. 


During  the  construction,  we  keep  track  of  two  types  of  cancellation, 
which  we  call  1-cancellation  and  2-cancel Xation.  We  1-cancel  an  index  i 
when  we  have  succeeded  in  defining  cpp^a  c)  such  a  vaY  that: 


(3x,y)(Vc)f(Cc|{0,...,y]  =  cp 


p(a,b,c) 


I  £0 . y} ) 


(<Pi(C)(x)  4  CA(x))]. 


CB), 


These  1-cancellations  will  be  used  to  insure  Compv  A  >  t  a.e 


We  2-cancel  an  index  i  when  we  have  insured  that  4  Cp ^ ^ 
Indices  i  get  2-cancelled  when  ii  is  less  than  tB  sufficiently  many 
times.  This  will  insure  Comp  B  >  tg  a.e. 


Once  an  index  is  1-caneelled  or  2-cencelled,  it  remains  so  at  all 
later  stages. 


Also,  at  any  particular  time  during  the  construction,  we  may  have 
some  "tentatively  1-cancel led"  indices.  If  an  index  i  is  tentatively 
1-caneelled,  a  pair  of  integers  (x  ,yt)  will  be  defined  such  that  if 
we  ever  discover  that  CA(Xj)  4  y ^  then  i  will  become  1-cancelled.  If 
we  ever  discover  that  (^(x^  =  y t,  then  the  tentative  1-cancellation  will 

be  removed. 


The  same  index  may  become  tentatively  1-cancelled  and  lose  its 
tentative  1-cancellation  repeatedly,  the  values  of  (x^y^  changing 
with  each  tentative  1-cancellation,  but  we  will  see  that  (in  the  cases 
in  which  we  are  interested)  may  index  can  only  become  tentatively 
1-cancelled  finitely  often. 

Finally,  at  any  time  during  the  construction  we  may  have  a 
"tentative  commitment  for  (an  index)  i".  A  tentative  commitment  for 
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i  is  a  quadruple  (i,x^,y^, z^) ,  where  z^  is  the  canonical  index  of  a  0-1 

valued  function  F  with  finite  domain  such  that: 

Zi 

(VC)  f(Cc  I  domain  Fz  =  Fg  )  =>  (cp^^x^  =  y1>], 

and  F  is  an  extension  of  the  finite  portion  of  ffi0/  .  .  defined  at  the 

^p(a,b,c) 

time  of  the  tentative  commitment  to  i.  The  tentative  commitment  is 
designed  to  allow  us  to  subsequently  tentatively  1-cancel  i,  if  possible. 

We  will  eventually  fulfill  the  tentative  commitment  for  i,  at 
which  time  i  becomes  tentatively  1-cancelled,  unless  we  are  interrupted 
by  the  2-cancellation  of  an  index  smaller  than  (i.e.  of  higher  priority 
than)  i,  or  by  a  new  tentative  commitment  for  an  index  smaller  than  1. 

In  both  the  following  constructions,  we  will  speak  of  the  "first" 
members  of  certain  collections  of  finite  sets;  it  is  to  be  understood 
that  the  ordering  we  are  using  is  lexicographic. 

At  the  beginning  of  Stage  0,  there  are  no  1-cancellations,  tentative 
1-cancellations,  or  2-cancellations,  or  tentative  commitments. 

Stage  n:  (Define  qpg(a  b  c)  (n) ) 

1.  Compute  $b(n)  and  $b(n  1). 

(If  either  diverges,  then  cpQ/  ,  .  will  diverge.) 

p(a,D,c; 

Let  X  ■  (x  £  $b(n)|$b(n  -  I)  <  §&(x)  s  $b(n)}. 

See  if  either  of  the  following,  (a)  or  (b),  holds: 

(a)  There  exist  i,  x,  E  such  that: 

(al)  i  s  n,  i  is  neither  1-cancelled  nor  tentatively  1-cancelled, 
and  if  there  is  a  tentative  commitment  for  some  j,  then  i  <  j, 
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(a2)  x  e  x, 

(a3)  E  c  { y | y  ^  h(i,x,$  (x)))  (where  h  Is  the  function  whose 
existence  is  asserted  in  lemma  4.2.1),  and: 

(Vy  *  n  -  l)'y  e  E  «  <Pp(a>bfC) (y)  =  U. 

and  (a4)  §1(E)(x)  ^  ^(x). 

(b)  There  exists  i  ^  n>  where  i  is  not  2-cancelled,  and  if  there  is  a 
current  tentative  commitment  for  some  j,  then  i  <  j,  and: 

$t(n)  *  *b(n). 

1.1.  If  neither  (a)  nor  (b)  holds, 

1.1.1.  If  there  is  no  current  tentative  commitment,  define 

<¥>0/  v  N(n)  =  0  and  go  on  to  substage  2. 

P(a,b,c) 

1  1.2.  If  there  is_  a  tentative  commitment  ( j  ,x^  ,y^  ,  z^) ,  let 

<¥>0/  l.  v  (n)  =  F  (n) .  Go  on  to  substage  2. 

0(a,b,c) 

1.2.  If  either  (a)  or  (b)  does  hold,  fix  1  to  be  the  smallest  index 
for  which  either  (a)  or  (b)  is  true. 

1.2.1.  If  i  arises  from  (a),  choose  the  x  such  that  $  (x)  is 

tl 

smallest  (if  two  arc  equal,  choose  the  smaller  x) ,  and 
for  this  x  choose  the  first  set  E  such  that  (i,x,E) 
satisfy  (a).  Remove  any  previous  tentative  commitment, 
and  make  a  new  tentative  commitment  for  i, 
(i,x,pi^E\x),zi), 

where  z ^  is  the  canonical  index  of  the  function: 

Fz  =  cEl(yly  *  max(n,h(i,x,$a(x)))} . 


1 
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Define  oo..  -  v  t  \ 

P(a,b,c)  ~  Fz  (n'»  and  8°  on  to  substage  2, 

1  ; 

1  2.2.  If  £  arises  from  (b)  but  not  from  (a),  deflue: 

^P(a,b,c)^  2  -VjCn), 

"*  *“■“  R“°Ve  “*  Pilous  tentative  co-.tueut 
and  go  on  to  substage  2. 

2.  See  if  there  is  a  current  tentative  commitment  (i.^.y',.  )  such  that 

n  S  max  (domain  F  ). 

Zi 

“  8°’  ism*  I.  associating  (x^,  rtth  the 

tentative  1-cancellation. 

i 

Remove  the  tentative  commitment  and  go  on  to  ,„bst.ge  3. 

2.2.  If  not,  then  just  go  on  to  sub. tag e  3.  i 

1 

3.  For  each  tentatively  1-cancelled  lndex  £  wlth  a„  ^  ,f 

Integers  (x^),  see  if  f^)  £  $b(n).  , 

3.1.  If  not,  then  make  no  change.  ,  , 

3.2.  If  so,  then: 


3.2.1.  if  qoc(x^)  _  remove  jig  tentative  1,- 


3.2.2.  If  <Pc(xt)  4  yv  remove  i's  tentative  1- 
,1 -cancel  i. 


cancellation.  i 
cancellation  and 


Go  on  to  stage  n  +  1.  i 

END  OF  CONSTRUCTION 

It  is  easy  to  verify  that  if  |fc  la  total,  then  for  any  ...  c  c 


/ 


I 


„  ,  <L  Od*,,.  b  c)  “  “-1  valUed' 


j  .1 

Now  choose  a*,  b*.  and  c*  such  that  $a*  =  *A>  *b*  =  fcB  aTld  ^c*  A 

1  i  i  1 

def  „ 

Let  Cfi  -  ^p(a*,b*,c*) 

w.  claim  that  this  set  B  has  the  required  properties.  The  key 
step  in  the  proof  is  the  cl,.tm  that  ho  index  gets  1-o.hoelled  i.o. 

It  ls  easy  to  see  that:Comp  B  >  t^e.e.  ,  es  in  earlier  proofs:  if 
,  a  t  i.o.,  then  i  will  he  2-caocelled  once  all  the  finitely-many 
higher'priority  ibices  which  are  over  going  to  he  Cancelled  are  so 
cancelled,  and  once  ell  the  (finitely  many,  tentative  1-cancell.tions  of 
higher  priority  irrfiees  have  Been  made.  When  i  is  2-eancelled,  clause 

1.2.2.  guarantees  that  cp^  4  CB* 

I  !  ! 


We  now  claim  that  Comp(B)A  >  tA  a.e. 


For  if  not,  then  there  is  an  index  i  such  that  <Pt  -  CA  and 

1 


$  £  t.  i.o. 

i  A 


such  an  i  could  never  he  Levelled  during  the  non. traction  of  B. 
for  this  would  mean  that  for  some  finite  set  E  and  some  argument  x. 

C  (x)  »q>  (E)(x)  by  the  1-cancellation, 

A  ,9lW(x)  '  hy  lemma  4,2.1,  and  clauses  1.2.1.  and  2.1. 

Therefore,' each  tentative  l-cmellition  of  i  will  eventually  he 

I 

removed  by  clause  3.2.1. 

w.  will  eventually  reach  some  stage  e  in  the  oenstruotion  of  B  such 
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that  ser  stage  e,  no  j  <  1  becomes  tentatively  1-cancelled  or 
2-cancelled.  Beyond  stage  e,  clauses  (a^  (b)  and  1.2  insure  that  no 
index  smaller  than  i  can  prevent  a  tentative  commitment  for  i  from  being 
wade,  nor  can  an  index  smaller  than  i  interrupt  such  a  tentative  com¬ 
mitment  for  i. 

Thus,  whenever  i  satisfies  clause  (a)  at  some  stage  n  >  e,  and  i  is 
not  already  tentatively  1-cancelled  at  stage  n,  i  will  become  tentatively 
1-cancelled  at  stage  n. 

/TJ  \ 

But  by  lemma  4.2.1,  '(x)  £  t^(x)  implies  the  existence  of  a  set  E 

such  that  (i,x,E)  satisfies  clause  (a).  Since  $^B\x)  £  tA(x)  i»o.,  i 
will  satisfy  clause  (a)  i.o.,  and  so  must  become  tentatively  1-cancelled 
i.o. 


But  we  have  assumed  that  no  index  i  is  tentatively  1-cancelled  i.o. 
Thus,  Comp^A  >  t^  a.e. 

It  remains  to  show  that  no  index  can  become  tentatively  1-cancelled 

infinitely  often.  In  order  to  do  this,  we  construct  (by  the  s-m-n  theorem) 

a  function  with  five  parameters,  cp  . 

y(a, b,c , a , e) 

The  parameters  are  to  be  thought  of  as  follows: 


d  =  the  first  index  which  becomes  tentatively  1-cancelled  infinitely 
many  times ,  and 
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e  =  the  number  of  a  stag  a  beyond  which  no  index  timelier  than  d  ever 
becomes  tentatively  1-cancelled  or  2-cancelled.  We  assume  e  >  d. 


Then!p^^a  ^  c  ^  will  represent  a  program  for  requiring  measure 
s  g  0  (for  an  appropriate  function  g).  We  will  let  this  be  the  g  in 
the  hypothesis  of  the  theorem,  so  that  we  here  obtain  a  contradiction 
to  "Comp  A  >  g  o  t^  a.e." 


Definition  of  <+>  ,  .  .  : 

_ Y(a,b,c,d  e) 

To  compute  cp  .  .  (x) ,  we  proceed  as  follows: 

Yva>  D>c,a,e; 

If  $a(x)t  or  (Vn) r§a(x)  >*b(n)],  then  Vy(a> b f c jd > e) (*) f • 
Otherwise,  let  n  =  fj.mr$a(x)  £ 


1.  If  e,  l*tlOY(.>lfCjd>e)(x)  -9c(x). 

2.  If  n  >  e,  then  perform  stages  0  through  n  -  1  in  the  construction 
of <Pp(a  b  .  At  the  point  immediately  after  completing  stage 

n  -  1,  see  if  either  there  is  a  tentative  commitment  (d.x^jy^, z^) 
or  d  is  tentatively  1-cancelled. 


2.1.  If  either  condition  is  true,  let  cp  ,  ,  .  .  (x)  *  cp  (x) . 

Y\a»k,c,ci,e)  c 

2.2.  Otherwise,  see  if  some  tentative  commitment  (d,x',y,z),  for 

x  4  x'  would  be  made  at  clause  1.2.1.  of  stage  n  in  the 

construction  of  cp  ,  ..  That  is,  see  if: 

P(a,b,c) 

(3X'  s  $  (x)) rr(§  (n  -  1)  <  §  (x')  <  $  (x))  V 

(§  (x)  =  $  (x1)  and  x'  <  x) 1  A 
»  & 

T(3e  =  {y|y  £  h(d,x',4  (x')»)  T(Vy  £  n  -  1)  (  y  e  E  » 


108 

»P(.,b,c)W  -  d  A  (*d(E)fr') *  v*'))in. 

2.2.1.  If  so,  l«¥v(<_biC_d>e)(x,  -,c(x). 

2.2.2.  If  rot,  then  see  if  (3e  =  (y|y  <;  h(d,x,$  (x)))) 

ft 

r(Vy  *  n  -  l)(y  e  E  «  <+)p(a,b,c)(y)  =  D  A 

($d(E)(x)  *  $fl(x))1. 

(We  are  checking  to  see  if  at  stage  n  in  the  con¬ 
struction  of  B,  a  tentative  commitment  (d,x,<¥>d^  (x)  ,z) 
was  made.) 


We  now  assume  (as  indicated  briefly  before  the  construction  of 
3Y(a,b,c,d, e)  t*iat  a*»  b*>  c*,  d*  and  e*  are  fixed  as  follows: 

a*  V 

$.  =  t 

b*  b* 

CP  =  c 

d*  »  the  first  index  which  becomes  tentatively  1-cancelled  infinitely 

many  times  during  the  construction  of  ,  and 

P(a*,b*,c*)’ 

e*  =  the  number  of  a  stage  in  the  construction  of  <po/  .  ,  .  .  after 

P(a*,b*,c*) 

which  no  index  smaller  than  d*  ever  becomes  tentatively 
1-cancelled  or  2-cancelled.  We  assume  e*  >  d*. 


We  claim  VY^a^b*fC*fd*>e*)  =  CA' 


For  all  clauses  except  2. 2. 2. 2.,  <s  _  M  _ 

^Y(a*,b*,c*,d*,e*)  ~  ^c*  ~  CA‘ 

We  must  check  what  happens  if  clause  2. 2. 2.2.  defines  <p 

(E)  Y(a*,b*,c*,d*,e*) W 

t°  beqp^^-'(x). 

If  2, 2.2.2.  is  executed  in  defining  some  p  _ 

^Y(a*,b*,c*,d*,e*) 

then  it  means  that  there  is  a  stage  n  >  e*  in  the  construction  of 

<^P(a*Jb*,c*)  at  which  d*’  x  and  some  set  E  satisfy  the  conditions  in 
1.  (a)  of  that  construction. 

d*  must  be  the  emelleet  Index  for  which  either  (.)  or  (b)  is  s.tisfied 
because  we  are  already  past  stage  e*. 

Thus,  in  stage  n  of  the  construction  of  Cp  clause  12  1 

p(a*,b*,c*)’  ciause  i.4.1. 

must  be  executed  for  i  =  d*. 

But  since  clause  2.2.1.  of  the  construction  of <p 
was  not  executed,  it  must  be  the  case  that  no  other  argument  x'  could 
interfere  with  a  tentative  commitment  (d*,x,yd*,  being  made  at  stage 

definition  of  <+3p(a*> b*,c*) »  and  80  some  tentative  commitment 
(d*>x><Pd*  ^x^,zd*^  WHI  Be  made. 

Eventually,  this  tentative  commitment  for  d*  will  cause  d*  to 
become  tentatively  1-cancelled,  since  n  >  e*.  When  d*  becomes 

tentatively  1-cancelled,  it  will  be  associated  with  the  pair  of  integers 
(x,<Pd*(E)(x)). 


Since  d*  becomes  tentatively  1-cancelled  infinitely  often  during 
construction  of  ^p(a*tb*,c*)  ’  t*1*s  tentative  cancellation  must 
eventually  be  removed.  This  can  only  happen  because  of  clause  3.2.1. 


at  some  stage  m  >  n  in  the  construction  of  cp 


P(a*,b*,c*) 


,  but  3.2.1.  gets 
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executed  only  if: 


(E) 


°A<x)  -V  <x> 

Thi.  establishes  the  dale  thst  <=A  - 

Next,  we  would  like  to  show  that: 

%(a*,b*,c*,d*,e*)  S  8  0  $a*  8  0  1'°* 

To  do  this,  we  must  first  define  g. 


Let  g(x,y)  =  max  g' (x,y,a,b,c,d,e) ,  where  we  will  define 

a,b,c,d,e^x 

g'  below.  The  idea  behind  the  definition  of  g1  is  the  following:  we 
list  enough  conditions,  each  recursive  assuming  the  preceding  ones  are 
satisfied,  to  Insure  thst  ?>Y(a>bjC>dje)  (x) .  sod  hence  *Y(>jb>c>d>e)  00 . 
converges.  On  the  other  hand,  we  don't  put  in  so  many  restrictions  that 
we  exclude  any  of  the  cases  we're  interested  in  (i.e.  we  only  list 
properties  actually  satisfied  by  a*,  b*,  c*,  d*  and  e*) . 

Here,  we  basically  follow  the  construction  of  qp  ,  t  ,  .  (x)  and 

y(a,b,c,d,e) 

select  which  of  the  conditions  on  a*,  b*,  c*,  d*  and  e*  were  needed  for 
the  convergence  of 

We  define  g' (x,y,a,b,c,d,e)  =  «  (x)  provided  all  the 

Y\a>D*c» a 

following  conditions  are  satisfied: 


1.  e  >  d, 

2-  y  =  $fl(x), 

3-  *b(y)  *  *a(x). 


Ill 


Then: 


4.1.  n  >  e, 

4.2.  Immediately  after  performing  stage  „  -  i  1rt  ^ 

*  se  11  “  1  in  the  construction 

P(*»b,c)  ’  ctlere  is  ^  tentative  commitment  (d,x  v  z  i 
«nd  d  is  not  tentatively  1-canceHed,  <>•  d’  d  • 

™S  “  “  -t  since  we  know  that  for  any 

m  <  n,  *„<■)  <  J<(x),  s0  that  ^ i .  suffices  ^ 

insure 

4.3.  There  is  no  x*  satisfying  clause  22  nf  +u 

3  *  use  i.2.  of  the  construction  of 

^(a.b.c.d.e) (x)>  Precisely, 

^  -  V*m-<.b(n  - 1,  <  v,.,  <  i>W)  v  (,aW  . ,  (Ml) 

ndx  <X)1  A  r(3E  £  (*l*  *  h(d.x',*a(x,))})r(V2  s  n  .1} 

(z  e  E  *  <Pp<a,b,c)  <*)  *  1)  A  ($d(E)(x')  £  $a(x'))]l]. 

4.4.  (3E  C  (z|*  s  h(d,x,$a(x))} ) 

^ sn  -  1)(2  sj  .  /r"\ 

^P(a,b,c)(z)  =  A  ($d(  *(x)  *  *(»))]. 

a 

If  one  of  the  conditions  fail,  to  be  satisfied,  we  define: 

8  (x»y»a,b,c,d,e)  =  0. 

Now  by  definition, 

8<M..<*)>  2  S'(*,y(x),«*,b*,o*,d*,e*)  a.e. 

=  $ 

Y(a*,b*,c*,d*,e*)(x)  for  all  x  such  that 

a  tentative  commitment  (d*,x,y  »  \ 

,yd*»zd*)  ls  made  «t  some  stage  after  stage 

e*  in  the  construction  of  B. 


But  since  we  have 


assumed  that  d*  Beta  t«v,i-os-j  ,  , 

gets  tentatively  1-cancelled 
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infinitely  often,  this  l.tter  .quality  amt  occur  for  tafi.mt.ly  *• 


•  x  s  e  o  $  ,  i.o. 

Thus,  we  have  *Y(a*,b*fc*fd*.«*)  6  a* 


,  „  =  r  ,  this  contradicts  the  hypothesis: 

But  since  ^PY(a*>b*>c*>d*,e*)  A* 

Comp  A  >  g  o  tA  a.e.  Therefore,  our  assumption  that  d*  was  tentatively 
1-cancelled  infinitely  often  was  wrong,  and  so  we  conclude  that  no 
index. gets  tentatively  1-cancelled  infinitely  often  in  the  construction 

of  <pp(a*,b*,c*)* 


QED 


Remark:  Part  of  the  difficulty  of  the  preceding  proof  arises  from  the 
fact  that  there  is  no  evident  effective  way  to  estimate  how  many 
tentative  commitments  for  an  index  may  be  removed.  The  resemblance  to 
finite  injury  priority  arguments  without  recursive  bounds  on  the  number 

of  injuries  is  readily  apparent. 


We  now  wish  to  discuss  the  relationship  between  theorems  6.3  and 
5.2.  As  in  the  parallel  discussion  for  theorem  6.2,  we  require  a 
"compressed"  version  of  the  theorem: 


We  obtain: 


PTnnnBition  6.3.3:  There  exists  g  «  R2  with  the  following  property: 
Whenever  we  have  total  running  times  tA  and  tB  with  tfi  monotone 


increasing,  and  a  recursive  set  A  with  Comp  A  >  g  o  tA  a.e.,  and  if 


t  2=  \xrxl ,  then  there  exists  a  recursive  set  B  such  that: 
A 


Comp  B  >  tB  a.e. 


Comp  B^  go  t  a.e. , 


and 


Comp(B)A  >  tA  a.e. 


/ 


/ 


Proof:  It  is  easy  to  verify  that  (Vx,a,b,c)  Tx  e  domain  cp 
whenever  {0,1 . x)  c  domain  §^]. 


P(a,b,c) 


Thus,  by  a  simple  domain-of-convergence  argument,  we  may  find  a 
function  g’  e  r^  such  that: 

W.o  s  8' 0  *b  ■••• 

whenever  is  monotone  increasing and  the  proposition  follows 
immediately  from  theorem  6.3. 


Having  this  stronger  version  of  theorem  6.3,  we  may  now  note  the 
following: 


Let  us  use  bhe  function  g  found  in  proposition  6.3.3. 


As  before,  define  g  e  to  be  >.x,y  rg(x,g(x,y)  ) .  Then  we  obtain, 

2 

by  theorem  5.2,  a  set  A  ,  which  is  i.o.  g  -improved  by  all  recursive 

g 

sets  B  whose  complexity  is  weakly  g-compressed  around  a  running  time. 
(That  is,  there  exists  a  total  running  time  t_  such  that  Comp  B  >  t_  i.o. 

D  D 

and  Comp  B  s  g  o  t.,  a.e.) 

D 

Now  assume  that  there  exists  a  recursive  function  t.  which  is  a 

A 

"good"  a.e.  lower  bound  for  A  ,is  complexity,  in  the  sense  that  CA 

8  g' 

can  actually  be  computed  a.e.  in  measure  not  much  greater  than  t^. 

If  such  a  function  t^  exists,  we  may  apply  proposition  6.3.3.  to 
t^  and  an  appropriate  t^  and  obtain  a  set  B.  What  is  B's  relationship  to 


B  must  g  -improve  A  ,  i.o.,  by  theorem  5.2.  On  the  other  hand, 

g 

since  B  preserves  the  a.e.  lower  bound  t.  (at  least  to  within  amount  g) , 
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it  is  impossible  that  B  g2-improve  A  ,  i.o-  But  this  is  a  coutradic- 

O 

tion. 

Hence,  we  see  that  the  assumed  existence  of  the  "good"  a.e.  lower 

bound  was  false,  so  A  ,  can  have  no  "good"  a.e.  lower  bound  on  its 

S 

complexity. 

Ooen  Question:  Can  we  obtain  a  more  symmetrical  version  of  theorem 
6.3,  in  which  A  also  preserves  a  lower  bound  on  B's  complexity?  (This 
is  stronger  than  theorem  4.8  because  the  set  A  may  be  fixed  arbitrarily.) 
One  way  of  formulating  this  is  ♦'he  following: 

Is  this  true: 

"There  exists  gSRj  with  the  following  property: 

Whenever  we  have  total  running  times  t^  and  tfi  with  tfi  monotone 
increasing,  and  a  recursive  set  A  with  Comp  A>  go  a.e.  ,  then  there 

exists  a  recursive  set  B  with: 

Comp(A)B  >  tfi  a.e. 

Comp  B  s  g  o  tg  a.e. 

and  Comp ^ A  >  tA  a.e."  ? 

Open  Question:  For  any  recursive  set  A,  we  have  found  sets  B  which 
preserve  any  single  a.e.  lower  bound  tA  on  A's  complexity,  provided  tA 
is  a  running  time.  Can  we  find,  for  each  A,  a  single  set  B  which 
preserves  all  running  time  a.e.  lower  bounds?  Further  discussion  of 
this  question  will  appear  in  Chapter  7. 

Open  Question:  In  theorem  6.3,  can  the  hypothesis  that  tA  is  a  running 


time  be  eliminated? 
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7.  Suggestions  for  Further  Study: 

In  this  chapter,  we  collect  open  problems  from  Chapters  3-6  and 
make  further  suggestions  for  additional  work. 

7.1.  In  theorem  6.3,  can  the  "running  time"  hypothesis  on  tA  be  eli¬ 
minated?  That  is,  can  we  prove  the  following  theorem: 

"There  exists  g  e  R2  with  the  following  property: 

For  any  tA  e  r^  (with  tA  >  \xfxl),  and  any  recursive  set  A 
with  Comp  A  >  g  o  tA  a.e. , 

there  exist  arbitrarily  complex  recursive  sets  B  such  that: 

Comp^A  >  tA  a.e."  ? 

7.2.  Can  we  strengthen  theorem  5.2  to  omit  or  weaken  the  complexity 
restrictions  on  B? 

For  example,  can  we  prove: 

"For  all  k  e  r2,  there  exist  sets  A  and  functions  t  e  R^  such 

that : 

(VB) rComp  B  >  r  a.e.  =»  B  k-improves  A  i.o.1"  ? 

There  are  other  possible  formulations  of  the  same  (intuitive) 
question. 

7.3.  Part  of  the  intention  of  introducing  the  notion  of  "helping"  was 
to  give  a  formal  interpretation  of  the  way  in  which  a  subroutine 
helps  the  computation  of  a  function.  (The  oracle  set  plays  the 
role  of  a  subroutine).  Intuitively,  it  appears  that  a  definition 
of  "helping"  which  accurately  reflects  this  situation  should  be 
transitive,  contrary  to  corollary  4.8.5.  We  see  that  the  difficulty 


/ 
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arises  because  the  ’helping  sets"  we  consider  in  the  counterexample 
are  in  fact  unlike  subroutines  because  they  encode  the  entire  function 
whose  computation  they  are  supposed  to  help  (i.e.,  we  say  B  join 
(B  ©  C)  helps  the  computation  of  C). 

We  would  like  some  way  of  eliminating  this  difficulty.  Can 
we  make  some  suitable  restriction  on  the  kinds  of  sets  allowed  jts_ 
oracles  (e.g.  restrict  their  complexity  relative  to  that  of  the 

function  being  helped)  to  make  our  notion  of  helping  a  transitive 
one? 


If  we  intend,  as  above,  to  give  a  formal  interpretation  of 
the  way  in  which  a  subroutine  helps  the  computation  of  a  function, 
then  we  should  not  restrict  our  attention  to  set  oracles,  but 
rather  we  should  have  a  model  for  computation  which  allows  help 
from  arbitrary  partial  recursive  functions. 

Some  work  in  this  direction  has  already  been  done  by  Symes  in 
his  thesis  rSyl.  Symes  has  defined  an  acceptable  ordering  of 
"subroutine  operators"  which  work  not  in  conjunction  with  an 
arbitrary  set  oracle  (as  do  relative  algorithms),  but  rather  in 
conjunction  with  a  partial  recursive  function.  Complexity  axioms 
in  the  style  of  Blum  are  then  developed  for  these  operators. 

7.4.  Consideration  of  the  kind  of  complexity  restrictions  needed  on  B  in 
theorem  5.2,  and  elsewhere  in  the  thesis,  leads  us  to  inquire  about 
the  relationships  between  the  different  types  of  complexity 


restrictions. 
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tor  example,  we  ask  which  of  the  following  statements  are  true; 

7.4.1.  (3g  e  R2)(Vh  e  R2)(3A,3t  e  Rj) 

Comp  A  >  t  a.e.  and  Comp  A  ^  g  o  t  a.e., 

but  such  that  for  no  total  running  time  t'  is  it  true  that; 

Comp  A  >  t'  a.e.  and  Comp  A  £  h  o  t'  a.e. 

("A  is  Btrongly _compr_esagd  but  not  between  honest  hounds.") 

7.4.2.  (3g  e  R2)(Vh  e  R2)(3A,3t  e  r  ) 

Comp  A  >  t  i.o.  and  Comp  A  s  g  o  t  a.e., 

but  such  that  for  no  total  running  time  t'  is  it  true  that; 
Comp  A  >  t'  i.o.  and  Comp  A  s  h  o  t*  a.e. 

("A  is  weakly  compressed  but  not  between  honest  bounds.") 

7.5.  Can  we  obtain  a  version  of  theorem  4.2  for  oracle  sets  B  which  are 
nonrecursive?  That  is,  can  we  find  any  way  to  bound  the  amount  of 
help  a  nonrecursive  set  B  can  give  the  computation  of  a  function  (for 
example,  relative  to  B'u  Turing-reducibility  properties,  or  to  B's 
complexity  relative  to  some  oracle  set)? 

7.6.  For  any  recursive  set  A,  theorem  6.2  gives  sets  B  which  preserve  any 
single  i.o.  lower  bound  t^  on  A's  complexity.  Can  we  find,  for  each 
A,  a  single  recursive  set  B  which  preserves  all  i.o.  lower  bounds 

on  A's  complexity  (or,  more  restrictively,  all  i.o.  lower  bounds 
which  happen  to  be  running  times) ?  This  would  imply  that  B  failed 
to  help  A,  in  a  somewhat  more  natural  sense  than  theorem  6.2. 

For  example,  it  might  be  possible  to  somehow  take  into  account 
all  i.o.  lower  bounds  on  A's  complexity,  and  hence  construct  B  by 


1 


working  from  all  the  i.o.  lower  bounds  rather  than  a  single  one. 

i 

7.7.  For  any  recursive  set  A,  we  have  found  sets  B  which  preserve  any 
single  running  time  a.e.  lower  bound  on  A's  complexity.  Can  we 
find,  for  each  A,  a  single  set  B  which  preserves  all  a  e.  lower 
bounds,  (or  all  running  time  a.e.  lower  bounds)? 

|  1 

A  serious  drawback  to  the  idea  of  taking  Into  account  oil  o.o. 

lower  bounis  on  A's  complexity  i.  the  following  claim  of  Meyer  'Mel: 

•  I 

"There  existe  e  recur.ive  set  A  such. that  no  sequence  of 

totel  functions  (p,l  sstisfies  the  following  properties:  ^ 

1 

(a)  Xi.x'p^x)]  is  recursive, 

(b)  (Vi)  fComp  A  >  p^^  a.e.  ] 

(c)  (Vr  £R1)r(CompA>r  a.e.)  *  (3j)(Pj  >  r  a.e.)  1"' 

We  do  not  know  whether  a  similar  result  holds  for.  i.o.  lower  bounds. 

■  i  i 

7.8.  In  Chapter  6.  the  set.  B  which  don't  help  A,  ffil  to  help  it  in  thst 

the,  preserve  .  given  lower  bound  on  A',  complexity.  It  would  be  nice 
to  be  able  to  sharpen  theorems  6.2  and  6.3  to  Involve  k- improvement, 
by  applying  them  to  a  single  "best  possible"  lower  bound  on  A'. 

I 

complexity. 

Unfortunately,  Blum's  speed-up  theorem  rBl)  tells  us  that  for 
some  recursive  functions,  no  lower  bound  is  close  enough  to  the 
actual  running  time  of  .  program  for  thst  function  to  insure  that 
the  resulting  set  B  does  not  k-lmprove  A.  Thst  is,  some  recursive 
functions  do  not  have  their  complexities  well-described  by  a  single 

!  '  I  I 

lower  bound  furction. 

i 

I  > 


I 


i 
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!  i 

However,  it  can  be  shown  >rMeFl  that  the  complexity  of  any  recursive 
function  may  be  described  by  a  sequence  of  recursive  functions 
(p.)  called  a  "complexity  sequence,"  having  some  nice  properties: 

’(a)  \i,xrpi(x)l  is  recursive, 

(b)  Each  p.'  iis  a  total  running  time, 

i  ■  i 

(c)  (Vi) rh  o  pi  ^  p1+1  a.e.]  (for  some  h  depending  on  the 
■  measure  only) . 

1  i 

Using  the  concept  of  a  "complexity  sequence,"  Meynr  has 

1 

I 

obtained  a  version  of  theorem  4.8  in  which  neither  of  the  sets  B 

i 

or  C  k-improves  the  other  .for  any  nontrivial  k. 

.1 

i  i 

In  the  hope  that  this  method  will  extend  to  other  problems 

1  ■  ■  1 

(notably  the  questions  in  Chapter  6),  it  would  be  nice  to  better 
understand  how  the  complexity  of  recursive  functions  can  be  character¬ 
ized  in  terms  of  fcomplexidy  sequences. 

For  example1,  two  specific  questions: 

7.8.1.  Does  every  recursive  functioh  f  have  a  0-1  valued  recursive 
function  g  with  "approximately"  the  same  complexity  sequence? 
This  means  that  there  exists  a  function  h  e  R2  depending  on 
the  measure  only,  for  which: 

(3  (fi),  a  complexity  sequence  for  f ) ,  and 

(3  { g  } ,  a  complexity  sequence  for  g) 

i  i  1  i 

'(^X^Xh0  fj.*  gj  a.e.)  A  (Vgi)(3fj)(h  O  g4  £  f^  a.e.)]. 

7.8.2.  Give  necessary  and  sufficient  conditions  on  a  sequence  of 

functions  that  it  be  a  complexity  sequence. 

!  i  ] 

i 

i 


i 
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For  example,  in  rL 1 ,  we  have  two  sets  of  sufficient  condi¬ 
tions,  where  each  set  of  conditions  includes  a  synchroni¬ 
zation  condition  (i.e.  infinitely  many  of  the  functions  in 
the  sequence  are  large  and  small  at  the  same  arguments) . 

However,  we  can  show  that  synchronization  conditions  are 
not  necessary  in  the  following  strong  sense:  we  can  obtain 
functions  f  with  effective  i.o.  speed-up  rB2j  such  that  no 
complexity  sequence  for  f  can  be  synchronized. 

7.9.  Many  other  questions  about  helping  besides  those  in  Chapters  4-6 
may  be  asked,  some  of  which  are  probably  answerable  by  methods 
similar  to  those  used  in  Chapters  4-6.  There  are  different  for¬ 
malizations  of  the  same  intuitive  questions,  but  some  examples  are: 

7.9.1.  Does  there  exist  a  "universally-helping  set"? 

Specifically,  is  it  true  that: 

(Vh  £  RgH^A,  a  recursive  set)(Vt,  total  running  times)  (Vb) 
r(Comp  B  >  t  a.e.  and  Comp  B  5  h  o  t  a.e.)  =*  (A  h-improves  B) ]  ? 

7.9.2.  Can  a  set  always  be  helped  in  a  "controlled"  way? 

Specifically,  is  it  true  that: 

(V h  £  I^) total  running  times  t,  t*  with  t  >  t')(3  recursive 
sets  A,B) 

r(Comp  A  >  t  a.e.)  A  (Comp  A  ^  h  o  t  a.e.)  A  (Comp^A  >  t*  a.e.) 
A  (Comp^A  ^  ho  t'  a.e.)]  ? 

7.10.  Is  theorem  4.6  true  without  the  monotonicity  restriction?  Namely, 
is  it  true  that: 

"There  exist  r  £  R^,  h  £  R2  with  the  following  property: 
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Whenever  t  is  a  running  time,  there  exists  a  recursive  set 
A  with: 

Comp  A  >  t  a.e. , 

Comp  A  £  h  o  t  a.e. , 
and  Comp^A  ^  r  a.e."  ? 

7.11.  Can  we  obtain  more  symmetrical  versions  of  theorems  6.2  and  6.3, 
in  which  A  also  preserves  a  lower  bound  on  B's  complexity? 

One  example  of  a  precise  formulation  of  this  question  for 
theorem  6.2  is  the  following:  Is  it  true  that: 

"There  exists  g  e  with  the  following  property: 

Whenever  we  have  tA>  tfi  e  Rp  a  a  recursive  set.  Comp  A 
>  8  °  ^  i.o.,  there  exists  a  recursive  set  B  such  that: 

Comp^B  >  tfi  i.o. 

Comp  B^go  t  a.e. 

and  Comp(B)A  >  tA  i.o."  ? 

7.12.  This  thesis  deals  almost  exclusively  with  results  about  functions 

(A) 

in  and  .  it  would  be  interesting  to  consider  similar 

results  in  and  For  example,  questions  7.4  and  7.8  may 

be  rephrased  for  partial  functions. 

We  may  use  Symes'  definitions  rSy 1  for  programs  with  partial 
recursive  functions  in  place  of  oracles,  and  reformulate  our 
questions  about  helping  in  these  terms. 

7.13.  Is  is  possible  to  strengthen  proposition  3.14  in  the  following  way: 

"Given  any  nonrecursive  set  A,  it  is  always  possible  to  find  a 
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set  B  such  that: 

a|b  and  A-reducibility  =  B-reducibilityl'  ? 

7.14.  Is  bounded  truth-table  reducibility ,  or  any  of  the  other  redu- 
cibilities  mentioned  by  Jonkusch  in  his  thesis  r ji ]  complexity- 
determined? 

7.15.  In  his  thesis,  Jockusch  develops  the  properties  of  various  types 
of  truth-table  reducibilities,  such  as  containment  properties  of 
degrees.  Explore  the  answers  to  these  questions  for  C-reducibili- 
ties  for  various  sets  C.  For  example,  does  C-reducibility  have 

any  properties  significantly  different  from  truth-table  reducibility? 
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